-- Logs begin at Wed 2022-07-27 07:07:40 UTC, end at Wed 2022-07-27 08:10:01 UTC. -- Jul 27 07:35:10.942878 dv-cinder-825492-32-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 07:35:10.954596 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 07:35:10 2022] *** Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: nodename: dv-cinder-825492-32-iscsi Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: machine: x86_64 Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: clock source: unix Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: pcre jit disabled Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: detected number of CPU cores: 4 Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: current working directory: / Jul 27 07:35:10.956286 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: detected binary path: /usr/bin/uwsgi-core Jul 27 07:35:10.956915 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: your processes number limit is 47680 Jul 27 07:35:10.956915 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: your memory page size is 4096 bytes Jul 27 07:35:10.956915 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: detected max file descriptor number: 2048 Jul 27 07:35:10.956915 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: lock engine: pthread robust mutexes Jul 27 07:35:10.956915 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: thunder lock: enabled Jul 27 07:35:10.956915 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 07:35:10.956915 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 07:35:10.996288 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: Python main interpreter initialized at 0x555bec13a9c0 Jul 27 07:35:10.996288 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: python threads support enabled Jul 27 07:35:10.996288 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: your server socket listen backlog is limited to 100 connections Jul 27 07:35:10.996288 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: your mercy for graceful operations on workers is 90 seconds Jul 27 07:35:10.996683 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 07:35:10.996766 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: *** Operational MODE: preforking *** Jul 27 07:35:10.997008 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: *** uWSGI is running in multiple interpreter mode *** Jul 27 07:35:10.997008 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: spawned uWSGI master process (pid: 80285) Jul 27 07:35:10.997223 dv-cinder-825492-32-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 27 07:35:10.998198 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: spawned uWSGI worker 1 (pid: 80295, cores: 1) Jul 27 07:35:10.998198 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: spawned uWSGI worker 2 (pid: 80296, cores: 1) Jul 27 07:35:10.998348 dv-cinder-825492-32-iscsi devstack@keystone.service[80285]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 07:35:16.577423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:35:16.577423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: from cryptography.utils import int_from_bytes Jul 27 07:35:16.578240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:35:16.578240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: from cryptography.utils import int_from_bytes Jul 27 07:35:16.616325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:35:16.616325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: from cryptography.utils import int_from_bytes Jul 27 07:35:16.616919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:35:16.616919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: from cryptography.utils import int_from_bytes Jul 27 07:35:16.627959 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 07:35:16.628154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 07:35:16.628350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] command line args: [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 07:35:16.628618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 07:35:16.628793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ================================================================================ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 07:35:16.629047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] admin_token = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.629286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] config_dir = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.629470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.629651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] config_source = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.629827 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] debug = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.630022 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.631464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.631464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.631464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.631464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.631464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.631464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_config_append = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.631909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.631909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_dir = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.631909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.632142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.632390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.632634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.632878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.633054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.633228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.633468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.633709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.633939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.634166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.634392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.634619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.634861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.635126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.635396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.635899 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.636079 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] publish_errors = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.636312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.636541 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.636717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.636963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.637194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.637424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] standard_threads = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.637738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.637891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.638068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.638262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_journal = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.638402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_json = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.638574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_stderr = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.638746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_syslog = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.638999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.639254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.639490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.639748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.639984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.640232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.640467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.640711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.640944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.641188 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.641431 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.641679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.641911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.642154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.642387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.642797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.643071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.643307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.643562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.643816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.644058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.644293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.644544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.644802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.645052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.645297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.645529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.645761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.645984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.646216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.646463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.646708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.646961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.647194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.647439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.647683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.647916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.648162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.648397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.648629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.648862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.649091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.649320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.649548 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.649776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.650009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.650256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.650486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.650719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.650969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.651207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.651439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.651686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.651915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.652150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.652383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.652616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.652849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.653082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.653309 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.653557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.653791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.654026 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.654255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.654513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.654747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.654999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.655235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.655470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.655739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.655976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.656223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.656466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.656700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.656933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.657164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.657409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.657642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.657875 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.658115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.658869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.659118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.659347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.659580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.659810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.660069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.660304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.660543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.660776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.661015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.661247 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.661479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.661739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.661972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.662202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.662431 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.662665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.662907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.663155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.663388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.663635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.663771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 07:35:16.663903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.664032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 07:35:16.664163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.664304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] command line args: [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 07:35:16.664448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.664584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 07:35:16.664584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ================================================================================ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 07:35:16.664860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.664996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] admin_token = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.665148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.external = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.665148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.665401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] config_dir = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.665401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.665642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.665781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] config_source = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.665917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.666058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] debug = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.666058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.666355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.password = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.666494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.666623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.token = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.666751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.666917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.667067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.667197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.667406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.667546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.667674 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.667802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.667929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_config_append = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.668057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.668204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.668204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_dir = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.668449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.668577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.668705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.668833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.668968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.669098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.669226 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.669355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.669489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.669618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.669757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.670176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.670451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.670584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.670714 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.670852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.671009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.671141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.671280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.671280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.671544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.671674 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.671803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.671980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.672129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.672260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.672396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.672534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.672664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.672792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.672922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.672922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.673185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.673316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.673445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] publish_errors = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.673582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.673734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.674486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.674633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.674773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.674933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.675071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.675202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.675340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.675471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.675642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.675783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] standard_threads = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.675915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.676045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.676186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.676334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.676334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.676579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.676710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_journal = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.676844 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.676984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_json = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.676984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_stderr = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.677230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.677366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_syslog = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.677496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.677625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:35:16.677764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.677895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.678035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.678174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.678310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.678460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.678600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.678731 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.678862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.679053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.679186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.679316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.679454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.679585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.679715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.679846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.679986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.680116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.680253 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.680384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.680513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.680642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.680771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.680901 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.681037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.681168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.681298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.681427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.681557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.681686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.681832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.681965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.682102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.682233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.682363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.682493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.682698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.682839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.683004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.683138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.683268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.683397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.683533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.683689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.683828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.683828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.684074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.684203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.684333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.684469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.684600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.684730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.684859 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.684987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.685117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.685254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.685395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.685526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.685655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.685785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.685914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.686052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.686191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.686322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.686452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.686581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.686711 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.686848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.687033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.687182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.687324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.687456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.687593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.687724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.687855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.687993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.688136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.688307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.688438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.688568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.688698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.688837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.688977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.689109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.689257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.689396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.689587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.689733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.689866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.690003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.690135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.690265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.690396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.690535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.690667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.690815 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.691024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.691174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.691306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.691453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.691586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.691717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.691848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.691978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.692109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.692248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.692388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.692519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.692650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.692781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.692912 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.693062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.693194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.693194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.693441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.693441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.693714 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.693847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.693977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.694107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.694238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.694368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.694506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.694639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.694779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.694935 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.695082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.695224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.695356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.695498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.695631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.695761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.695891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.695891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.696171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.696310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.696442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.696573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.696715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.696847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.696978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.697117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.697249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.697385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.697516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.697648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.697786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.697994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.698127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.698258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.698389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.698533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.698673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.698805 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.698971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.699106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.699237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.699367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.699505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.699636 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.699768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.699898 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.700027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.700157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.700295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.700437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.700569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.700698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.700829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.700959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.701098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.701230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.701360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.701498 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.701635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.701767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.701907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.702039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.702169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.702309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.702440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.702570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.702708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.702846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.703038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.703170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.703301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.703432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.703579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.703716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.703846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.703985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.704126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.704266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.704404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.704537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.704668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] role.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.704809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.704941 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] role.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.705584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.705732 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.705865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.705997 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.706128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.706259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.706390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.706540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.706673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.706803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.706954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.external = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.707094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.707226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.707369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.707369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.707618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.707756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.707894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.708025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.708165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.password = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.708308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.708439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.token = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.708570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.708700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.708830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.708970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.709101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.709239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.709239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.709486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.709616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.709755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.709887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.710017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.710158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.710290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.710427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.710560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.710690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.710821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.710980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.711126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.711267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.711400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.711531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.711662 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.711793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.711934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.712073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.712206 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.712338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.712468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.712607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.712737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.712875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.713008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.713138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.713269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.713400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.713537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.713693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.713826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.713958 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.714089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.714219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.714349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.714489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.714621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.714751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.714911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.715050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.715182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.715182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.715442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.715442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.715701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.715832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.715963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.715963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.716219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.716351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.716482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.716613 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.716744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.716883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.717015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.717146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.717276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.717417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.717550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.717693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.717826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.717958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.718089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.718220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.718351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.718489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.718622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.718753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.718913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.719053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.719196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.719340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.719481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.719481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.719738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.719869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.720006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.720006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.720262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.720394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.720525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.721504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.721652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.721831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.722002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.722144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.722298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.722478 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.722631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.722769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.723044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.723187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.723319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.723449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.723586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.723722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.723864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.723998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.724141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.724273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.724404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.724535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.724674 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.724812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.724945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 07:35:16.725741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.725741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.726815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.726815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.726815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.726815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.726815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.726815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.726815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.726815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.726815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.727931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.727931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.727931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.727931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.727931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.727931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.727931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.727931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.727931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.729000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.729000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.729000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.729000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.729000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.729000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.729000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.729000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.729000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.730079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.730079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.730079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.730079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.730079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.730079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.730079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.730079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.730079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.731242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.731242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.731242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.731242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.731242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.731242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.731242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.731242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.731242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.732306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.732306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.732306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.732306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.732306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.732306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.732306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.732306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.732306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.733383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.733383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.733383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.733383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.733383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.733383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.733383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.733383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.733383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.734468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.734468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.734468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] role.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.734468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] role.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.734468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.734468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.734468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.734468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.734468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.735571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.735571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.735571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.735571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.735571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.735571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.735571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.736437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.736437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.736437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.736800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.736929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.737126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.737376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.737628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.737865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.738121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.738372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.738612 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.738843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.739100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.739335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.739588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.739843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.740093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.740336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.740574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.740808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.741044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.741302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.741550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.741787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.742043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.742293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.742533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.742778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.743045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.743296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.743534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.743672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.743818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.743961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.743961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.744229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.744229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.744478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.744684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.744928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.745226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.745489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.745733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.745980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.746217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.746458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.746692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.746954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.747192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.747427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.747671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.747907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.748152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.748387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.748634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.748875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.749121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.749352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.749591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.749826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:35:16.749994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 07:35:16.752237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.774974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.775203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.775428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.781886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.782114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.783829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.803776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.804003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.834493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.840751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.884634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.884857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.887878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.888115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.949823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.949984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.950072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.950167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.950249 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.950385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.950481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.950596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.950683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.950808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.950931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.951046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.974832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.975086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.975313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.975402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.975535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.975620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.975752 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.975845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.975965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.976049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.976177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.976260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.976461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.976677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.987237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.987578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:16.999955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.000184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.000332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.000418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.000569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.000653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.000798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.000890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.001014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.001096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.001226 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.001310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.001437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.001652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 07:35:17.018561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.018761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 07:35:17.019116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.019253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.019351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 07:35:17.019466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 07:35:17.019551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.019798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.019880 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.019994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 07:35:17.020078 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.020265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.020348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.020525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.020782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.021035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.029917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.030186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.030449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.030724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.030825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.031024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.031293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.031575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.038261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.039142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.043045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.043322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.043596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.043867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.043976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.044136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.044254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.044385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.044532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.044644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.044809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.044892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.045086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.045167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.045342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.045423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.045607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.045690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.045887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.046143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.046409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.046669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.068933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.070214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.070409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.070685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.071738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.072015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.075300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.075576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.075856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.076648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.076925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.077207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.083030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.083310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.084402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.084678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.087491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.087774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.088048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.088329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.088597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.088768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.088875 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.089066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.089148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.089347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.089441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.089627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.089909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.090184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.090461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.090740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.105510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.105778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.107100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.107379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.109776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.111657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.112948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.113252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.115375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.115747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.117611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.120777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.122105 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.124021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.124311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.124597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.124886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.125173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.125325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.125455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.129044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.129398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.129715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.129999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.130291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.130574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.141916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.142194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.142457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.143286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.149927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.150213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.150295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.150482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.150801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.151823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.152094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.154924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.155202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.155497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.155775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.156068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.158304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.159964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.160245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.163103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.163382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.163680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.163965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.164253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.167443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.167719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.167993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.168267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.168538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.168803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.169069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.175765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.176043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.176324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.176603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.176881 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.177153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.177426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.184590 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.187566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.191027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.193517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.193607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.195126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.195374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.195665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.196796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.200150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.202179 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.202924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.203793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.204423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.204708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.204993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.206991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.207278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.207558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.207831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.211596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.213192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.215845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.216130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.216216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.216407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.216490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.216710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.216986 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.224027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.224302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.224573 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.224845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.225122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.225400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.225670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.225885 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.225969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.226174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.226286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.226456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.226571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.226845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.227130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.227391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.227643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.233356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 07:35:17.233631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.233910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.234184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.234470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.234742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.235055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.235319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.235688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.235966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.236249 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.236573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.236848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.237106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 07:35:17.262214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555bec13a9c0 pid: 80295 (default app) Jul 27 07:35:17.265574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835404bb-1e7b-459c-8788-8089ab55ae8d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:17.265858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835404bb-1e7b-459c-8788-8089ab55ae8d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:17.266127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835404bb-1e7b-459c-8788-8089ab55ae8d None None] PATH_INFO: `/v3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:17.270518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Jul 27 07:35:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:17.271250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555bec13a9c0 pid: 80296 (default app) Jul 27 07:35:24.936341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c2f35-a022-4d60-b648-49ca85a53507 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:24.936932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c2f35-a022-4d60-b648-49ca85a53507 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:24.936932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c2f35-a022-4d60-b648-49ca85a53507 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:24.938215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:24.946418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:24.946865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:24.946998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:25.018420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: INFO dbcounter [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] Registered counter for database keystone Jul 27 07:35:25.039224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG oslo_db.sqlalchemy.engines [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:35:25.045323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writer thread running {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:35:25.229074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG passlib.handlers.bcrypt [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80296) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 07:35:25.229396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG passlib.handlers.bcrypt [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80296) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 07:35:25.283855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:25.285455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:25.410456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1/3] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 07:35:25.541949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c2f35-a022-4d60-b648-49ca85a53507 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:25.611690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: INFO dbcounter [None req-078c2f35-a022-4d60-b648-49ca85a53507 None None] Registered counter for database keystone Jul 27 07:35:25.630921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG oslo_db.sqlalchemy.engines [None req-078c2f35-a022-4d60-b648-49ca85a53507 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:35:25.637096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writer thread running {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:35:25.756335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c2f35-a022-4d60-b648-49ca85a53507 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:25.760867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795412b-dbf1-4e43-adb6-6aea0bf1d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:25.761522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795412b-dbf1-4e43-adb6-6aea0bf1d9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:25.761810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795412b-dbf1-4e43-adb6-6aea0bf1d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:25.762084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795412b-dbf1-4e43-adb6-6aea0bf1d9b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:25.770767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795412b-dbf1-4e43-adb6-6aea0bf1d9b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:25.825746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5795412b-dbf1-4e43-adb6-6aea0bf1d9b6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 07:35:25.826093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795412b-dbf1-4e43-adb6-6aea0bf1d9b6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:25.836973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Jul 27 07:35:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:35:25.842994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:25.857934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666832-3a5a-4427-b73b-bc138a790f78 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:25.862389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd100efd-8eaa-446b-8adb-3a86f0d10aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:25.863509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd100efd-8eaa-446b-8adb-3a86f0d10aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:25.863787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd100efd-8eaa-446b-8adb-3a86f0d10aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:25.864056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd100efd-8eaa-446b-8adb-3a86f0d10aaf admin admin] PATH_INFO: `/v3/projects/b01056c5a4f74067a3bc2250b32736cc` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:25.865640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd100efd-8eaa-446b-8adb-3a86f0d10aaf admin admin] RBAC: Authorizing `identity:get_project(project_id=b01056c5a4f74067a3bc2250b32736cc)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:25.917830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd100efd-8eaa-446b-8adb-3a86f0d10aaf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 07:35:25.918172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd100efd-8eaa-446b-8adb-3a86f0d10aaf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:25.922812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 2/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Jul 27 07:35:25 2022] GET /identity/v3/projects/b01056c5a4f74067a3bc2250b32736cc => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:27.926250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e056fce-1840-428e-8273-2766c370af7f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:27.926790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e056fce-1840-428e-8273-2766c370af7f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:27.926790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e056fce-1840-428e-8273-2766c370af7f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:27.930926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 4/6] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:27.936208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba28e1-0e35-4dba-a4f7-5cfab16db9c1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:27.936591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba28e1-0e35-4dba-a4f7-5cfab16db9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:27.936774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba28e1-0e35-4dba-a4f7-5cfab16db9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:27.957173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e4ba28e1-0e35-4dba-a4f7-5cfab16db9c1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:27.958720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e4ba28e1-0e35-4dba-a4f7-5cfab16db9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:27.966708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 07:35:27.989312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e056fce-1840-428e-8273-2766c370af7f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:28.001368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e056fce-1840-428e-8273-2766c370af7f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:28.005956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8e479-56cd-4e52-9fab-6d6cc4b6770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:28.006569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8e479-56cd-4e52-9fab-6d6cc4b6770b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:28.006848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8e479-56cd-4e52-9fab-6d6cc4b6770b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:28.007150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8e479-56cd-4e52-9fab-6d6cc4b6770b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:28.014984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8e479-56cd-4e52-9fab-6d6cc4b6770b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:28.016774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8e479-56cd-4e52-9fab-6d6cc4b6770b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:28.026043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Jul 27 07:35:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:35:28.031714 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba28e1-0e35-4dba-a4f7-5cfab16db9c1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:28.041475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba28e1-0e35-4dba-a4f7-5cfab16db9c1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:28.045892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5438d-d079-4ad8-b4e9-a915b3ef403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:28.046511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5438d-d079-4ad8-b4e9-a915b3ef403f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:28.046792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5438d-d079-4ad8-b4e9-a915b3ef403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:28.047093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5438d-d079-4ad8-b4e9-a915b3ef403f admin admin] PATH_INFO: `/v3/users/0d288edc5a024ebe8b9e0a02e9598b35` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:28.048456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5438d-d079-4ad8-b4e9-a915b3ef403f admin admin] RBAC: Authorizing `identity:get_user(user_id=0d288edc5a024ebe8b9e0a02e9598b35)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:28.050312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5438d-d079-4ad8-b4e9-a915b3ef403f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:28.051890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 4/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Jul 27 07:35:28 2022] GET /identity/v3/users/0d288edc5a024ebe8b9e0a02e9598b35 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:30.137039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2377-d1ba-46f6-b3bc-58db65f23cdd None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:30.137569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2377-d1ba-46f6-b3bc-58db65f23cdd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:30.137654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2377-d1ba-46f6-b3bc-58db65f23cdd None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:30.139014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:30.139482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9269a-d383-4166-89aa-9af9b4954efe None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:30.139844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9269a-d383-4166-89aa-9af9b4954efe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:30.140117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9269a-d383-4166-89aa-9af9b4954efe None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:30.141459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 5/11] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:35:30.143813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2ea65-1a13-4f78-a25a-122f3ec347d7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:30.144094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2ea65-1a13-4f78-a25a-122f3ec347d7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:30.144366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2ea65-1a13-4f78-a25a-122f3ec347d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:30.146748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b45648-6a6a-4d9e-a7d2-2bf74949d9b0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:30.147073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b45648-6a6a-4d9e-a7d2-2bf74949d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:30.147346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b45648-6a6a-4d9e-a7d2-2bf74949d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:30.166539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-60b45648-6a6a-4d9e-a7d2-2bf74949d9b0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:30.167760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-60b45648-6a6a-4d9e-a7d2-2bf74949d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:30.186806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG passlib.handlers.bcrypt [None req-ccc2ea65-1a13-4f78-a25a-122f3ec347d7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80295) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 07:35:30.187266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG passlib.handlers.bcrypt [None req-ccc2ea65-1a13-4f78-a25a-122f3ec347d7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80295) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 07:35:30.233457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ccc2ea65-1a13-4f78-a25a-122f3ec347d7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:30.235090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ccc2ea65-1a13-4f78-a25a-122f3ec347d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:30.247206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:35:30.270526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b45648-6a6a-4d9e-a7d2-2bf74949d9b0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:30.294541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:30.337915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:30.360215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2ea65-1a13-4f78-a25a-122f3ec347d7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:30.378192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b45648-6a6a-4d9e-a7d2-2bf74949d9b0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:30.412411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fbafd-f0ac-4231-85b0-80579a577f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:30.412991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fbafd-f0ac-4231-85b0-80579a577f2e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:30.413276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fbafd-f0ac-4231-85b0-80579a577f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:30.413550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fbafd-f0ac-4231-85b0-80579a577f2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:30.430202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fbafd-f0ac-4231-85b0-80579a577f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ec6fbafd-f0ac-4231-85b0-80579a577f2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:30.440369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:30.441258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:30.442090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:35:30.447671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fbafd-f0ac-4231-85b0-80579a577f2e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:30.466298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2ea65-1a13-4f78-a25a-122f3ec347d7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:30.468665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:30.506165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6812aa9-12bf-4c99-8986-ed927ec62795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:30.507068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6812aa9-12bf-4c99-8986-ed927ec62795 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:30.507357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6812aa9-12bf-4c99-8986-ed927ec62795 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:30.507636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6812aa9-12bf-4c99-8986-ed927ec62795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:30.531401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:30.550499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fbafd-f0ac-4231-85b0-80579a577f2e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:30.574625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6812aa9-12bf-4c99-8986-ed927ec62795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:30.576177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6812aa9-12bf-4c99-8986-ed927ec62795 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:30.584607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcfd98-d5eb-410a-9ad3-4f4119537b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:30.585229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcfd98-d5eb-410a-9ad3-4f4119537b68 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:30.585510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcfd98-d5eb-410a-9ad3-4f4119537b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:30.585783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcfd98-d5eb-410a-9ad3-4f4119537b68 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:30.586513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcfd98-d5eb-410a-9ad3-4f4119537b68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:30.586814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcfd98-d5eb-410a-9ad3-4f4119537b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:30.588235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcfd98-d5eb-410a-9ad3-4f4119537b68 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:30.600792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:30.606460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcfd98-d5eb-410a-9ad3-4f4119537b68 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:30.675377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 07:35:30.680904 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6812aa9-12bf-4c99-8986-ed927ec62795 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:30.683934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:30.787383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6812aa9-12bf-4c99-8986-ed927ec62795 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:30.812626 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcfd98-d5eb-410a-9ad3-4f4119537b68 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:30.823116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3a0d7-ac62-446d-b4fb-bd73b8876b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:30.823974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3a0d7-ac62-446d-b4fb-bd73b8876b1b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:30.824248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3a0d7-ac62-446d-b4fb-bd73b8876b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:30.824513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3a0d7-ac62-446d-b4fb-bd73b8876b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:30.843225 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3a0d7-ac62-446d-b4fb-bd73b8876b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:30.844683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3a0d7-ac62-446d-b4fb-bd73b8876b1b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:30.847742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba71ce6-26e2-41d0-a566-688e9b9bb6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:30.848383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba71ce6-26e2-41d0-a566-688e9b9bb6da None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:30.848662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba71ce6-26e2-41d0-a566-688e9b9bb6da None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:30.848937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba71ce6-26e2-41d0-a566-688e9b9bb6da None admin] PATH_INFO: `/v3/users/0d288edc5a024ebe8b9e0a02e9598b35` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:30.850106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba71ce6-26e2-41d0-a566-688e9b9bb6da None admin] RBAC: Authorizing `identity:get_user(user_id=0d288edc5a024ebe8b9e0a02e9598b35)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:30.851580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba71ce6-26e2-41d0-a566-688e9b9bb6da None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:30.853172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:30 2022] GET /identity/v3/users/0d288edc5a024ebe8b9e0a02e9598b35 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:30.858541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba71ce6-26e2-41d0-a566-688e9b9bb6da None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-53e3a0d7-ac62-446d-b4fb-bd73b8876b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:35:30.862850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:30.863672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:30.864658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:35:30.864658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:35:30.864658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:35:30.864658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:35:30.864658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:35:30.869699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3a0d7-ac62-446d-b4fb-bd73b8876b1b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:30.873381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:30.926978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:30.963055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba71ce6-26e2-41d0-a566-688e9b9bb6da None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:30.975195 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3a0d7-ac62-446d-b4fb-bd73b8876b1b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:31.002430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0786c9-2a78-4505-b71d-25710825080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:31.003098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0786c9-2a78-4505-b71d-25710825080d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:31.003377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0786c9-2a78-4505-b71d-25710825080d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:31.003655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0786c9-2a78-4505-b71d-25710825080d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:31.004826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0786c9-2a78-4505-b71d-25710825080d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:31.006272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0786c9-2a78-4505-b71d-25710825080d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:31.007869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:31.011318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfdf4c-a027-41ea-9f10-24e9e00348cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:31.011959 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfdf4c-a027-41ea-9f10-24e9e00348cb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:31.012242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfdf4c-a027-41ea-9f10-24e9e00348cb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:31.012518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfdf4c-a027-41ea-9f10-24e9e00348cb None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:31.013234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfdf4c-a027-41ea-9f10-24e9e00348cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:31.013538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfdf4c-a027-41ea-9f10-24e9e00348cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:31.013920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0786c9-2a78-4505-b71d-25710825080d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:31.014946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfdf4c-a027-41ea-9f10-24e9e00348cb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:31.032529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:31.108675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:31.130353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0786c9-2a78-4505-b71d-25710825080d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:31.166123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd564af-6cca-4729-9d1e-4c71561d3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:31.166784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd564af-6cca-4729-9d1e-4c71561d3020 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:31.167051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd564af-6cca-4729-9d1e-4c71561d3020 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:31.167320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd564af-6cca-4729-9d1e-4c71561d3020 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:31.168138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd564af-6cca-4729-9d1e-4c71561d3020 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.domain.id=default, user.id=0d288edc5a024ebe8b9e0a02e9598b35) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:31.168448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd564af-6cca-4729-9d1e-4c71561d3020 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:31.169929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd564af-6cca-4729-9d1e-4c71561d3020 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:31.178321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Jul 27 07:35:31 2022] GET /identity/v3/role_assignments?user.id=0d288edc5a024ebe8b9e0a02e9598b35&scope.domain.id=default&role.id=2ba3b2926541436a9d26782420538af3 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:33.625939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe02a-23b5-4507-bb08-d5c615e5a7f3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:33.626444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe02a-23b5-4507-bb08-d5c615e5a7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:33.626550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe02a-23b5-4507-bb08-d5c615e5a7f3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:33.628390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:33.644747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6d89d-5d21-40b3-8837-5a0cb8ff6eb7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:33.645243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6d89d-5d21-40b3-8837-5a0cb8ff6eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:33.645314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6d89d-5d21-40b3-8837-5a0cb8ff6eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:33.671899 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e4d6d89d-5d21-40b3-8837-5a0cb8ff6eb7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:33.673133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e4d6d89d-5d21-40b3-8837-5a0cb8ff6eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:33.772639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:33.795169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe02a-23b5-4507-bb08-d5c615e5a7f3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:33.816745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc690-5790-4ed3-8481-615da02360bd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:33.817068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc690-5790-4ed3-8481-615da02360bd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:33.817308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc690-5790-4ed3-8481-615da02360bd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:33.818949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:33.823811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7f74-0e9c-49f2-9512-ae8012fe5669 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:33.824086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7f74-0e9c-49f2-9512-ae8012fe5669 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:33.824365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7f74-0e9c-49f2-9512-ae8012fe5669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:33.848935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6bfa7f74-0e9c-49f2-9512-ae8012fe5669 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:33.850155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6bfa7f74-0e9c-49f2-9512-ae8012fe5669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:33.966799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:33.968099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff5696-a0f3-4e48-868e-e3adadbd4666 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:33.968379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff5696-a0f3-4e48-868e-e3adadbd4666 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:33.968650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff5696-a0f3-4e48-868e-e3adadbd4666 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:33.969942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 15/26] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:33.975910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b555b-3fdf-4b9b-99d7-9995ac63136c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:33.976479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b555b-3fdf-4b9b-99d7-9995ac63136c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:33.976952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b555b-3fdf-4b9b-99d7-9995ac63136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:33.984674 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:33.999467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe02a-23b5-4507-bb08-d5c615e5a7f3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:34.004531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d54b555b-3fdf-4b9b-99d7-9995ac63136c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:34.005721 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d54b555b-3fdf-4b9b-99d7-9995ac63136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:34.021894 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:34.041750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1711e-9a23-4d0d-ae66-adf427cd14af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:34.042628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1711e-9a23-4d0d-ae66-adf427cd14af None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.043228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1711e-9a23-4d0d-ae66-adf427cd14af None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.043630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1711e-9a23-4d0d-ae66-adf427cd14af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.056583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1711e-9a23-4d0d-ae66-adf427cd14af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-48f1711e-9a23-4d0d-ae66-adf427cd14af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:34.065304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:34.066389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:34.067306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:35:34.069168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 12/27] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:34.070654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5dcd1-cb19-4be4-9488-480ad9c232f0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.071089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5dcd1-cb19-4be4-9488-480ad9c232f0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.071516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5dcd1-cb19-4be4-9488-480ad9c232f0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.077080 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 13/28] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:34.078093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5dcd1-cb19-4be4-9488-480ad9c232f0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:34.083558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 16/29] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:34.084448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b555b-3fdf-4b9b-99d7-9995ac63136c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:34.207905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5dcd1-cb19-4be4-9488-480ad9c232f0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:34.222643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b555b-3fdf-4b9b-99d7-9995ac63136c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:34.246499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae7528-5142-4423-84d7-dcac595930a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:34.247371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae7528-5142-4423-84d7-dcac595930a8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.247744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae7528-5142-4423-84d7-dcac595930a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.248112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae7528-5142-4423-84d7-dcac595930a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.259043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae7528-5142-4423-84d7-dcac595930a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:34.260647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae7528-5142-4423-84d7-dcac595930a8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:34.266784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7442a7-23aa-4fc3-ad99-747f229fc3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:34.267967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7442a7-23aa-4fc3-ad99-747f229fc3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.268296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7442a7-23aa-4fc3-ad99-747f229fc3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.268581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7442a7-23aa-4fc3-ad99-747f229fc3b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.269329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7442a7-23aa-4fc3-ad99-747f229fc3b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:34.269640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7442a7-23aa-4fc3-ad99-747f229fc3b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:34.271107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7442a7-23aa-4fc3-ad99-747f229fc3b0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:34.272790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:34.288942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 17/30] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:34.290478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e809-2c1d-427f-ac07-0162fabe8617 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.290772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e809-2c1d-427f-ac07-0162fabe8617 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.291153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e809-2c1d-427f-ac07-0162fabe8617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.312472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e612e809-2c1d-427f-ac07-0162fabe8617 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:34.313790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e612e809-2c1d-427f-ac07-0162fabe8617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-55ae7528-5142-4423-84d7-dcac595930a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:35:34.384744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:34.386526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:34.388456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:35:34.388456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:35:34.388456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:35:34.388456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:35:34.388456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 14/31] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:34.388456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae7528-5142-4423-84d7-dcac595930a8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:34.396261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 18/32] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:34.397299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612e809-2c1d-427f-ac07-0162fabe8617 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:34.422005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:34.500038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae7528-5142-4423-84d7-dcac595930a8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:34.535564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612e809-2c1d-427f-ac07-0162fabe8617 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:34.536507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dc0ba-3b1c-47e2-bc77-3cc8fdd71370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:34.537205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc0ba-3b1c-47e2-bc77-3cc8fdd71370 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.537582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc0ba-3b1c-47e2-bc77-3cc8fdd71370 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.537921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc0ba-3b1c-47e2-bc77-3cc8fdd71370 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.538738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dc0ba-3b1c-47e2-bc77-3cc8fdd71370 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:34.540228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dc0ba-3b1c-47e2-bc77-3cc8fdd71370 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:34.565580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:34.576185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be349919-1130-40f8-ba1e-b4fcea3e7ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:34.576976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be349919-1130-40f8-ba1e-b4fcea3e7ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.577334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be349919-1130-40f8-ba1e-b4fcea3e7ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.577682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be349919-1130-40f8-ba1e-b4fcea3e7ee9 None admin] PATH_INFO: `/v3/users/0d288edc5a024ebe8b9e0a02e9598b35` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.578974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be349919-1130-40f8-ba1e-b4fcea3e7ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=0d288edc5a024ebe8b9e0a02e9598b35)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:34.580597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be349919-1130-40f8-ba1e-b4fcea3e7ee9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:34.582580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 19/33] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:34 2022] GET /identity/v3/users/0d288edc5a024ebe8b9e0a02e9598b35 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:34.587638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be349919-1130-40f8-ba1e-b4fcea3e7ee9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:34.678768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 15/34] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 27 07:35:34 2022] POST /identity/v3/roles => generated 219 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:34.679944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dc0ba-3b1c-47e2-bc77-3cc8fdd71370 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:34.710926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be349919-1130-40f8-ba1e-b4fcea3e7ee9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:34.766063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11000700-de8f-46e8-9447-2c4c46e94e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:34.767982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000700-de8f-46e8-9447-2c4c46e94e14 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.768722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000700-de8f-46e8-9447-2c4c46e94e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.769142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000700-de8f-46e8-9447-2c4c46e94e14 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.770016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11000700-de8f-46e8-9447-2c4c46e94e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:34.770488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11000700-de8f-46e8-9447-2c4c46e94e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:34.772403 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11000700-de8f-46e8-9447-2c4c46e94e14 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:34.796162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 20/35] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:34.797235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11000700-de8f-46e8-9447-2c4c46e94e14 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:34.803929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:34.825518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dc0ba-3b1c-47e2-bc77-3cc8fdd71370 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:34.871749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:34.881981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c54abb-2b24-4c03-98b8-98f274aba562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:34.882741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c54abb-2b24-4c03-98b8-98f274aba562 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.883058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c54abb-2b24-4c03-98b8-98f274aba562 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.883517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c54abb-2b24-4c03-98b8-98f274aba562 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.884196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c54abb-2b24-4c03-98b8-98f274aba562 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:34.885750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c54abb-2b24-4c03-98b8-98f274aba562 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:34.904823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 16/36] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 27 07:35:34 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:34.906611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561284-74f1-4ef8-9750-9a47d25139d5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.906915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561284-74f1-4ef8-9750-9a47d25139d5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.907289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561284-74f1-4ef8-9750-9a47d25139d5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.908999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 17/37] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:34.913870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c561284-74f1-4ef8-9750-9a47d25139d5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:34.933141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11000700-de8f-46e8-9447-2c4c46e94e14 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:34.988369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28940be8-4baa-468a-89c2-33194f5629f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:34.989039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28940be8-4baa-468a-89c2-33194f5629f8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.989534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28940be8-4baa-468a-89c2-33194f5629f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.989829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28940be8-4baa-468a-89c2-33194f5629f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:34.991672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28940be8-4baa-468a-89c2-33194f5629f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:34.993522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28940be8-4baa-468a-89c2-33194f5629f8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:34.996506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 21/38] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:34.998508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a48cf1-118f-4132-a171-00ed343af163 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:34.998857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a48cf1-118f-4132-a171-00ed343af163 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:34.999235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a48cf1-118f-4132-a171-00ed343af163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:35.023519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-47a48cf1-118f-4132-a171-00ed343af163 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:35.024900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-47a48cf1-118f-4132-a171-00ed343af163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:35.067162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c561284-74f1-4ef8-9750-9a47d25139d5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:35.101290 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 22/39] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:35.102055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a48cf1-118f-4132-a171-00ed343af163 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:35.112310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee30ada-30a8-4098-8219-d0eb9b8235f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:35.112942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee30ada-30a8-4098-8219-d0eb9b8235f6 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:35.113223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee30ada-30a8-4098-8219-d0eb9b8235f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:35.113494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee30ada-30a8-4098-8219-d0eb9b8235f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:35.114436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee30ada-30a8-4098-8219-d0eb9b8235f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:35.116004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee30ada-30a8-4098-8219-d0eb9b8235f6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:35.143805 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:35.151257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 18/40] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:35:34 2022] POST /identity/v3/projects => generated 301 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:35.154055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655639f2-4968-4c33-95a3-742354bd454f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:35.154420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655639f2-4968-4c33-95a3-742354bd454f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:35.154772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655639f2-4968-4c33-95a3-742354bd454f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:35.161701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 19/41] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:35.162382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655639f2-4968-4c33-95a3-742354bd454f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:35.166300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:35.226436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a48cf1-118f-4132-a171-00ed343af163 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:35.270934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9724f24-ab2d-4f6d-a887-1c467d88a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:35.271744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9724f24-ab2d-4f6d-a887-1c467d88a5d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:35.272028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9724f24-ab2d-4f6d-a887-1c467d88a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:35.272303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9724f24-ab2d-4f6d-a887-1c467d88a5d1 None admin] PATH_INFO: `/v3/domains/default/users/0d288edc5a024ebe8b9e0a02e9598b35/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:35.274448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9724f24-ab2d-4f6d-a887-1c467d88a5d1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0d288edc5a024ebe8b9e0a02e9598b35, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:35.276020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9724f24-ab2d-4f6d-a887-1c467d88a5d1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:35.290386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655639f2-4968-4c33-95a3-742354bd454f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:35.330630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d72f18-7262-4968-89ba-60dc4ab770dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:35.331341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d72f18-7262-4968-89ba-60dc4ab770dc None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:35.331629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d72f18-7262-4968-89ba-60dc4ab770dc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:35.331907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d72f18-7262-4968-89ba-60dc4ab770dc None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:35.332793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d72f18-7262-4968-89ba-60dc4ab770dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:35.334218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d72f18-7262-4968-89ba-60dc4ab770dc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:35.350450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 20/42] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 27 07:35:35 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:35.351786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf724e4-c901-49e3-be61-3b7c46c0f505 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:35.352026 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf724e4-c901-49e3-be61-3b7c46c0f505 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:35.352308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf724e4-c901-49e3-be61-3b7c46c0f505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:35.377727 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ddf724e4-c901-49e3-be61-3b7c46c0f505 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:35.379711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ddf724e4-c901-49e3-be61-3b7c46c0f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:35.397236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 23/43] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Jul 27 07:35:35 2022] PUT /identity/v3/domains/default/users/0d288edc5a024ebe8b9e0a02e9598b35/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:35:35.458296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:35.474453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 21/44] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:35.498232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9724f24-ab2d-4f6d-a887-1c467d88a5d1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:35.614646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9724f24-ab2d-4f6d-a887-1c467d88a5d1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:35.628541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:35.650308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597dc43-50f0-41d3-b066-005ccf7c98bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:35.650998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597dc43-50f0-41d3-b066-005ccf7c98bb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:35.651285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597dc43-50f0-41d3-b066-005ccf7c98bb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:35.651561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597dc43-50f0-41d3-b066-005ccf7c98bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:35.652821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597dc43-50f0-41d3-b066-005ccf7c98bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:35.654490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597dc43-50f0-41d3-b066-005ccf7c98bb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:35.658997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 24/45] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:35.664846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf724e4-c901-49e3-be61-3b7c46c0f505 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:35.765467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf724e4-c901-49e3-be61-3b7c46c0f505 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:35.799097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f59ccd-085f-4787-93f1-3ef71df36b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:35.799721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f59ccd-085f-4787-93f1-3ef71df36b4e None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:35.800007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f59ccd-085f-4787-93f1-3ef71df36b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:35.800285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f59ccd-085f-4787-93f1-3ef71df36b4e None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:35.800976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f59ccd-085f-4787-93f1-3ef71df36b4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:35.802450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f59ccd-085f-4787-93f1-3ef71df36b4e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:35.829181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 22/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:35:35 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:37.451726 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68afc2-f603-4c1c-b231-fa487573741a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:37.452221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68afc2-f603-4c1c-b231-fa487573741a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:37.452433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68afc2-f603-4c1c-b231-fa487573741a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:37.453883 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 25/47] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:37.459136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e55ef-5c6d-4712-b475-3716684b9c1a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:37.459537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e55ef-5c6d-4712-b475-3716684b9c1a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:37.459706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e55ef-5c6d-4712-b475-3716684b9c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:37.478492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-517e55ef-5c6d-4712-b475-3716684b9c1a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:37.479785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-517e55ef-5c6d-4712-b475-3716684b9c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:37.514836 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:37.549586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 23/48] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:37.572889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68afc2-f603-4c1c-b231-fa487573741a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:37.677614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68afc2-f603-4c1c-b231-fa487573741a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:37.713873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da795f1-deab-43e6-875e-1e1059644a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:37.714522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da795f1-deab-43e6-875e-1e1059644a6c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:37.714809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da795f1-deab-43e6-875e-1e1059644a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:37.715167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da795f1-deab-43e6-875e-1e1059644a6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:37.726529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da795f1-deab-43e6-875e-1e1059644a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9da795f1-deab-43e6-875e-1e1059644a6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:37.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:37.733010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:37.733878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 26/49] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:37.740607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e55ef-5c6d-4712-b475-3716684b9c1a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:37.839106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e55ef-5c6d-4712-b475-3716684b9c1a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:37.865812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db52e4a-8312-46f6-a474-799fe53ffa26 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:37.866106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db52e4a-8312-46f6-a474-799fe53ffa26 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:37.866392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db52e4a-8312-46f6-a474-799fe53ffa26 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:37.868223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 27/50] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:37.873019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc66ee-2ec0-467d-a54c-8bd3970198c6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:37.873310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc66ee-2ec0-467d-a54c-8bd3970198c6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:37.873594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc66ee-2ec0-467d-a54c-8bd3970198c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:37.875387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593a0a6-aca4-486e-955e-e713dc857fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:37.876015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a0a6-aca4-486e-955e-e713dc857fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:37.876316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a0a6-aca4-486e-955e-e713dc857fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:37.876592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a0a6-aca4-486e-955e-e713dc857fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:37.877327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593a0a6-aca4-486e-955e-e713dc857fa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:37.877636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593a0a6-aca4-486e-955e-e713dc857fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:37.879044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593a0a6-aca4-486e-955e-e713dc857fa9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:37.890934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 24/51] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:37.894144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-15fc66ee-2ec0-467d-a54c-8bd3970198c6 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:37.896061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-15fc66ee-2ec0-467d-a54c-8bd3970198c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:37.897128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593a0a6-aca4-486e-955e-e713dc857fa9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:37.930724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:37.931768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:37.965970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 28/52] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:35:37.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc66ee-2ec0-467d-a54c-8bd3970198c6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:37.997222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593a0a6-aca4-486e-955e-e713dc857fa9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:38.030481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313aee74-e3c3-42ff-8ef9-803186dd6bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:38.031158 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313aee74-e3c3-42ff-8ef9-803186dd6bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:38.031449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313aee74-e3c3-42ff-8ef9-803186dd6bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:38.031729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313aee74-e3c3-42ff-8ef9-803186dd6bc3 None admin] PATH_INFO: `/v3/users/0d288edc5a024ebe8b9e0a02e9598b35` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:38.033266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313aee74-e3c3-42ff-8ef9-803186dd6bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=0d288edc5a024ebe8b9e0a02e9598b35)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:38.034716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313aee74-e3c3-42ff-8ef9-803186dd6bc3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:38.036356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 25/53] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:37 2022] GET /identity/v3/users/0d288edc5a024ebe8b9e0a02e9598b35 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:38.041880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313aee74-e3c3-42ff-8ef9-803186dd6bc3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:38.089322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc66ee-2ec0-467d-a54c-8bd3970198c6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:38.130034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d204aa-c9bf-45f9-9dd6-57e38e596a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:38.130685 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d204aa-c9bf-45f9-9dd6-57e38e596a80 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:38.130988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d204aa-c9bf-45f9-9dd6-57e38e596a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:38.131266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d204aa-c9bf-45f9-9dd6-57e38e596a80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:38.132441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d204aa-c9bf-45f9-9dd6-57e38e596a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:38.133904 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d204aa-c9bf-45f9-9dd6-57e38e596a80 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:38.135522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 29/54] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:38.141065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d204aa-c9bf-45f9-9dd6-57e38e596a80 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:38.150568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313aee74-e3c3-42ff-8ef9-803186dd6bc3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:38.152383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:38.182931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:38.186703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbd122-2407-4a5c-9566-8176a4ddec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:38.187392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbd122-2407-4a5c-9566-8176a4ddec54 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:38.187678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbd122-2407-4a5c-9566-8176a4ddec54 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:38.187955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbd122-2407-4a5c-9566-8176a4ddec54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:38.189657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbd122-2407-4a5c-9566-8176a4ddec54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:38.191148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbd122-2407-4a5c-9566-8176a4ddec54 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:38.192749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 26/55] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:38.199138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbd122-2407-4a5c-9566-8176a4ddec54 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:38.245334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d204aa-c9bf-45f9-9dd6-57e38e596a80 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:38.278879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541faa9-0d20-4ffb-a19d-747a5304d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:38.279519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541faa9-0d20-4ffb-a19d-747a5304d4e5 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:38.279797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541faa9-0d20-4ffb-a19d-747a5304d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:38.280067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541faa9-0d20-4ffb-a19d-747a5304d4e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:38.280747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541faa9-0d20-4ffb-a19d-747a5304d4e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:38.282193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541faa9-0d20-4ffb-a19d-747a5304d4e5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:38.299669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbd122-2407-4a5c-9566-8176a4ddec54 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:38.309803 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 30/56] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Jul 27 07:35:38 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:35:38.336669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b21123-8c2d-4b97-9be3-e48c542461e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:38.337325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b21123-8c2d-4b97-9be3-e48c542461e7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:38.337609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b21123-8c2d-4b97-9be3-e48c542461e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:38.337882 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b21123-8c2d-4b97-9be3-e48c542461e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:38.338704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b21123-8c2d-4b97-9be3-e48c542461e7 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.domain.id=default, user.id=0d288edc5a024ebe8b9e0a02e9598b35) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:38.339378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b21123-8c2d-4b97-9be3-e48c542461e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:38.340891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b21123-8c2d-4b97-9be3-e48c542461e7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:38.355557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 27/57] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Jul 27 07:35:38 2022] GET /identity/v3/role_assignments?user.id=0d288edc5a024ebe8b9e0a02e9598b35&scope.domain.id=default&role.id=2ba3b2926541436a9d26782420538af3 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:40.351914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019291a8-dc7f-49c6-b07b-36c57382ccf0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:40.352439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019291a8-dc7f-49c6-b07b-36c57382ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:40.352439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019291a8-dc7f-49c6-b07b-36c57382ccf0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:40.353828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 31/58] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:40.359043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0105-e323-44f6-a5a6-589abb6c59f9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:40.359409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0105-e323-44f6-a5a6-589abb6c59f9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:40.359596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0105-e323-44f6-a5a6-589abb6c59f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:40.377653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-86fe0105-e323-44f6-a5a6-589abb6c59f9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:40.378843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-86fe0105-e323-44f6-a5a6-589abb6c59f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:40.404470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:40.444971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 28/59] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:40.468464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019291a8-dc7f-49c6-b07b-36c57382ccf0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:40.557475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:40.569033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019291a8-dc7f-49c6-b07b-36c57382ccf0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:40.601561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba8917-0f95-4c58-9f1f-bbca81bed1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:40.602243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba8917-0f95-4c58-9f1f-bbca81bed1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:40.602470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba8917-0f95-4c58-9f1f-bbca81bed1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:40.602741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba8917-0f95-4c58-9f1f-bbca81bed1c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:40.603919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba8917-0f95-4c58-9f1f-bbca81bed1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:40.605406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba8917-0f95-4c58-9f1f-bbca81bed1c0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:40.606984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 32/60] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:40.613107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe0105-e323-44f6-a5a6-589abb6c59f9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:40.708565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe0105-e323-44f6-a5a6-589abb6c59f9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:40.742622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfc58e-e944-4a9a-b705-b55743874d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:40.743264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc58e-e944-4a9a-b705-b55743874d8c None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:40.743550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc58e-e944-4a9a-b705-b55743874d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:40.743824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc58e-e944-4a9a-b705-b55743874d8c None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:40.744528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc58e-e944-4a9a-b705-b55743874d8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:40.745999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc58e-e944-4a9a-b705-b55743874d8c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:40.772648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 29/61] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:35:40 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:43.878763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a186-241d-44af-9a6f-e05eb24b999f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:43.879342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a186-241d-44af-9a6f-e05eb24b999f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:43.879342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a186-241d-44af-9a6f-e05eb24b999f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:43.880693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 33/62] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:43.885940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f454fa-896f-4263-bdbf-8c45d08cc6f3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:43.886815 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f454fa-896f-4263-bdbf-8c45d08cc6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:43.887352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f454fa-896f-4263-bdbf-8c45d08cc6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:43.911877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-52f454fa-896f-4263-bdbf-8c45d08cc6f3 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:43.913434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-52f454fa-896f-4263-bdbf-8c45d08cc6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:43.932122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:44.003229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 30/63] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:44.019314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7a8d-4dcb-4113-91d1-bcf3951e38c0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.019914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7a8d-4dcb-4113-91d1-bcf3951e38c0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.020391 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7a8d-4dcb-4113-91d1-bcf3951e38c0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.021955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 34/64] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:44.027330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b6d85-0a86-46be-a9d0-31b501a16ae4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.027623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b6d85-0a86-46be-a9d0-31b501a16ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.027902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b6d85-0a86-46be-a9d0-31b501a16ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.048979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7a8d-4dcb-4113-91d1-bcf3951e38c0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:44.056404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b24b6d85-0a86-46be-a9d0-31b501a16ae4 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:44.056404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b24b6d85-0a86-46be-a9d0-31b501a16ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:44.149045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 31/65] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:44.156605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113e81e-eb76-428b-a539-1b176cca732f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.157041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113e81e-eb76-428b-a539-1b176cca732f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.157489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113e81e-eb76-428b-a539-1b176cca732f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.159235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 32/66] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:44.167853 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306ff4b-f3d4-402b-9e53-74e1c4252974 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.168653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306ff4b-f3d4-402b-9e53-74e1c4252974 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.169340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306ff4b-f3d4-402b-9e53-74e1c4252974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.209878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7a8d-4dcb-4113-91d1-bcf3951e38c0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:44.212910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4306ff4b-f3d4-402b-9e53-74e1c4252974 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:44.215315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4306ff4b-f3d4-402b-9e53-74e1c4252974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:44.250544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb627318-f801-4808-9490-839a5012f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:44.251226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb627318-f801-4808-9490-839a5012f170 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.252179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb627318-f801-4808-9490-839a5012f170 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.252713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb627318-f801-4808-9490-839a5012f170 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.265975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb627318-f801-4808-9490-839a5012f170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-cb627318-f801-4808-9490-839a5012f170 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:44.271815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:44.272890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:44.273875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:44.275891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 35/67] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:35:44.281488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb627318-f801-4808-9490-839a5012f170 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:44.296702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 33/68] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:44.297458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306ff4b-f3d4-402b-9e53-74e1c4252974 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:44.305577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:44.324344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:44.394730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb627318-f801-4808-9490-839a5012f170 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:44.435918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306ff4b-f3d4-402b-9e53-74e1c4252974 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:44.439807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f90f08-a8f9-4aad-9f8c-59aa5177a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:44.440464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f90f08-a8f9-4aad-9f8c-59aa5177a976 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.440749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f90f08-a8f9-4aad-9f8c-59aa5177a976 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.441026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f90f08-a8f9-4aad-9f8c-59aa5177a976 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.452747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f90f08-a8f9-4aad-9f8c-59aa5177a976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-05f90f08-a8f9-4aad-9f8c-59aa5177a976 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:44.458724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:44.459639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:44.460387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 36/69] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:44.461006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f90f08-a8f9-4aad-9f8c-59aa5177a976 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:44.479430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7fafa-65a0-4678-84af-be6ec08ea9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:44.480058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fafa-65a0-4678-84af-be6ec08ea9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.480381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fafa-65a0-4678-84af-be6ec08ea9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.480658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fafa-65a0-4678-84af-be6ec08ea9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.481397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7fafa-65a0-4678-84af-be6ec08ea9f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:44.481700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7fafa-65a0-4678-84af-be6ec08ea9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:44.483156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7fafa-65a0-4678-84af-be6ec08ea9f7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:44.492662 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 34/70] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:44.493885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd600b0-97d5-42d2-a1ec-c8dd0fa2979a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.494171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd600b0-97d5-42d2-a1ec-c8dd0fa2979a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.494445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd600b0-97d5-42d2-a1ec-c8dd0fa2979a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.498938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 35/71] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:44.498938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd600b0-97d5-42d2-a1ec-c8dd0fa2979a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:44.554383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:44.576230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f90f08-a8f9-4aad-9f8c-59aa5177a976 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:44.582030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:44.615238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b5636-a15b-4724-b805-4fca08b67950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:44.615987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5636-a15b-4724-b805-4fca08b67950 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.616274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5636-a15b-4724-b805-4fca08b67950 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.616543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5636-a15b-4724-b805-4fca08b67950 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.621236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd600b0-97d5-42d2-a1ec-c8dd0fa2979a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:44.627935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b5636-a15b-4724-b805-4fca08b67950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-431b5636-a15b-4724-b805-4fca08b67950 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:44.632879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:44.633779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:44.634542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:44.636653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b5636-a15b-4724-b805-4fca08b67950 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:44.661515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344dec-5b26-4cf9-9a07-5cb415c88776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:44.662151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344dec-5b26-4cf9-9a07-5cb415c88776 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.662450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344dec-5b26-4cf9-9a07-5cb415c88776 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.662706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344dec-5b26-4cf9-9a07-5cb415c88776 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.663502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344dec-5b26-4cf9-9a07-5cb415c88776 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:44.663812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344dec-5b26-4cf9-9a07-5cb415c88776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:44.665205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344dec-5b26-4cf9-9a07-5cb415c88776 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:44.679568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:44.679568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac356f-c613-4837-abd6-cbbd39ea36d1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.679568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac356f-c613-4837-abd6-cbbd39ea36d1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.679568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac356f-c613-4837-abd6-cbbd39ea36d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.694461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7aac356f-c613-4837-abd6-cbbd39ea36d1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:44.695780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7aac356f-c613-4837-abd6-cbbd39ea36d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:44.748996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b5636-a15b-4724-b805-4fca08b67950 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:44.762559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 37/74] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:44.763570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac356f-c613-4837-abd6-cbbd39ea36d1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:44.790933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb370b-e7f4-4d91-9863-76860d99ef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:44.791578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb370b-e7f4-4d91-9863-76860d99ef12 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.791860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb370b-e7f4-4d91-9863-76860d99ef12 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.792326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb370b-e7f4-4d91-9863-76860d99ef12 None admin] PATH_INFO: `/v3/users/b8d6cc1775b14b0db17609fec02d67a9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.799695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:44.806558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb370b-e7f4-4d91-9863-76860d99ef12 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d6cc1775b14b0db17609fec02d67a9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:44.808075 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb370b-e7f4-4d91-9863-76860d99ef12 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:44.809739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/users/b8d6cc1775b14b0db17609fec02d67a9 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:44.810512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb370b-e7f4-4d91-9863-76860d99ef12 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:44.830756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:44.868151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac356f-c613-4837-abd6-cbbd39ea36d1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:44.902545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1497c0c-ab26-44c0-bb3c-8bfb76e82ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:44.903218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1497c0c-ab26-44c0-bb3c-8bfb76e82ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.903463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1497c0c-ab26-44c0-bb3c-8bfb76e82ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.903732 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1497c0c-ab26-44c0-bb3c-8bfb76e82ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.904456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1497c0c-ab26-44c0-bb3c-8bfb76e82ea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:44.904757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1497c0c-ab26-44c0-bb3c-8bfb76e82ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:44.906124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1497c0c-ab26-44c0-bb3c-8bfb76e82ea5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:44.914343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 38/76] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:44.914668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb370b-e7f4-4d91-9863-76860d99ef12 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:44.915555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5a715-734c-4db2-ac02-593ea896078d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.915851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5a715-734c-4db2-ac02-593ea896078d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.916132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5a715-734c-4db2-ac02-593ea896078d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.917893 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 39/77] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:44.919666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5a715-734c-4db2-ac02-593ea896078d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:44.950519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef98f86-4533-44e3-bbfc-e86108a94678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:44.951119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef98f86-4533-44e3-bbfc-e86108a94678 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:44.951398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef98f86-4533-44e3-bbfc-e86108a94678 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:44.951670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef98f86-4533-44e3-bbfc-e86108a94678 None admin] PATH_INFO: `/v3/users/b8d6cc1775b14b0db17609fec02d67a9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:44.952849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef98f86-4533-44e3-bbfc-e86108a94678 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d6cc1775b14b0db17609fec02d67a9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:44.954279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef98f86-4533-44e3-bbfc-e86108a94678 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:44.956473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/users/b8d6cc1775b14b0db17609fec02d67a9 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:44.957227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef98f86-4533-44e3-bbfc-e86108a94678 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.020961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.025473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5a715-734c-4db2-ac02-593ea896078d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:45.050432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.059665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7563a7-8b4d-4c60-bcbb-da0779e71b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:45.059837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef98f86-4533-44e3-bbfc-e86108a94678 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:45.060306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7563a7-8b4d-4c60-bcbb-da0779e71b8e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.060585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7563a7-8b4d-4c60-bcbb-da0779e71b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.060857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7563a7-8b4d-4c60-bcbb-da0779e71b8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.071558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7563a7-8b4d-4c60-bcbb-da0779e71b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2f7563a7-8b4d-4c60-bcbb-da0779e71b8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:45.076872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:45.077949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:35:45.078738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:45.079406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7563a7-8b4d-4c60-bcbb-da0779e71b8e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.099962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa182fde-ee0c-4c65-9700-eaeb70a0e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:45.100547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa182fde-ee0c-4c65-9700-eaeb70a0e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.100830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa182fde-ee0c-4c65-9700-eaeb70a0e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.101105 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa182fde-ee0c-4c65-9700-eaeb70a0e2d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.170140 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa182fde-ee0c-4c65-9700-eaeb70a0e2d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:45.171643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa182fde-ee0c-4c65-9700-eaeb70a0e2d0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:45.182989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7563a7-8b4d-4c60-bcbb-da0779e71b8e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:45.217343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f94ad-cb01-4b73-9232-d9a01be273ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:45.217872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f94ad-cb01-4b73-9232-d9a01be273ac None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.218157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f94ad-cb01-4b73-9232-d9a01be273ac None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.218434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f94ad-cb01-4b73-9232-d9a01be273ac None admin] PATH_INFO: `/v3/users/0d288edc5a024ebe8b9e0a02e9598b35` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.219669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f94ad-cb01-4b73-9232-d9a01be273ac None admin] RBAC: Authorizing `identity:get_user(user_id=0d288edc5a024ebe8b9e0a02e9598b35)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:45.221419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f94ad-cb01-4b73-9232-d9a01be273ac None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:45.223068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 41/80] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:45 2022] GET /identity/v3/users/0d288edc5a024ebe8b9e0a02e9598b35 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:45.224210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ef4c-ae9d-425f-90a3-461de227a9e6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.224493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ef4c-ae9d-425f-90a3-461de227a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.224765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ef4c-ae9d-425f-90a3-461de227a9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.232781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.243394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d6c9ef4c-ae9d-425f-90a3-461de227a9e6 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:45.244612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d6c9ef4c-ae9d-425f-90a3-461de227a9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:45.274151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 40/81] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:45.275035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa182fde-ee0c-4c65-9700-eaeb70a0e2d0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.298230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.317758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 42/82] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:45.319054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ef4c-ae9d-425f-90a3-461de227a9e6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.379686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa182fde-ee0c-4c65-9700-eaeb70a0e2d0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:45.412937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3acfd-c45a-494d-b114-26ce6f855db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:45.413557 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3acfd-c45a-494d-b114-26ce6f855db6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.413844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3acfd-c45a-494d-b114-26ce6f855db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.414114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3acfd-c45a-494d-b114-26ce6f855db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.434299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ef4c-ae9d-425f-90a3-461de227a9e6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:45.445477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.469951 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dc508-1e37-426a-8fd3-f20eb3d3db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:45.470528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc508-1e37-426a-8fd3-f20eb3d3db15 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.470831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc508-1e37-426a-8fd3-f20eb3d3db15 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.471401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc508-1e37-426a-8fd3-f20eb3d3db15 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.472161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dc508-1e37-426a-8fd3-f20eb3d3db15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:45.472468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dc508-1e37-426a-8fd3-f20eb3d3db15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:45.473879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dc508-1e37-426a-8fd3-f20eb3d3db15 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:45.482168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 43/83] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:35:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:45.483019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dc508-1e37-426a-8fd3-f20eb3d3db15 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.483998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3acfd-c45a-494d-b114-26ce6f855db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:45.485504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3acfd-c45a-494d-b114-26ce6f855db6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:45.529462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.582871 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dc508-1e37-426a-8fd3-f20eb3d3db15 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:45.584808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 41/84] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:45.585664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3acfd-c45a-494d-b114-26ce6f855db6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.623384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912c1f-a2f2-4253-9a0e-fd0c001f9669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:45.624269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912c1f-a2f2-4253-9a0e-fd0c001f9669 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.624701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912c1f-a2f2-4253-9a0e-fd0c001f9669 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.625145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912c1f-a2f2-4253-9a0e-fd0c001f9669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.650305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.689359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3acfd-c45a-494d-b114-26ce6f855db6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:45.693315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912c1f-a2f2-4253-9a0e-fd0c001f9669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:45.694785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912c1f-a2f2-4253-9a0e-fd0c001f9669 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:45.723409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e47ff-cb8a-49b7-9fbf-4ea618fe984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:45.723970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e47ff-cb8a-49b7-9fbf-4ea618fe984e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.724254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e47ff-cb8a-49b7-9fbf-4ea618fe984e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.724530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e47ff-cb8a-49b7-9fbf-4ea618fe984e None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.725700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e47ff-cb8a-49b7-9fbf-4ea618fe984e None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:45.727173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e47ff-cb8a-49b7-9fbf-4ea618fe984e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:45.728844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 42/85] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:45 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:45.729610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e47ff-cb8a-49b7-9fbf-4ea618fe984e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.740862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.795503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 44/86] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:45.796354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912c1f-a2f2-4253-9a0e-fd0c001f9669 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.830630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e47ff-cb8a-49b7-9fbf-4ea618fe984e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:45.861369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.866945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e28035-109f-42c2-9fcb-ddcb7175ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:45.867596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e28035-109f-42c2-9fcb-ddcb7175ec17 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.867877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e28035-109f-42c2-9fcb-ddcb7175ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.868158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e28035-109f-42c2-9fcb-ddcb7175ec17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.869445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e28035-109f-42c2-9fcb-ddcb7175ec17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:45.870923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e28035-109f-42c2-9fcb-ddcb7175ec17 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:45.872527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 43/87] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:45.873296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e28035-109f-42c2-9fcb-ddcb7175ec17 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.901631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912c1f-a2f2-4253-9a0e-fd0c001f9669 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:45.935413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74839aa7-ffac-454c-8a52-0c4075a63dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:45.936052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74839aa7-ffac-454c-8a52-0c4075a63dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:45.936331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74839aa7-ffac-454c-8a52-0c4075a63dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:45.936600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74839aa7-ffac-454c-8a52-0c4075a63dd4 None admin] PATH_INFO: `/v3/users/b8d6cc1775b14b0db17609fec02d67a9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:45.937816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74839aa7-ffac-454c-8a52-0c4075a63dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d6cc1775b14b0db17609fec02d67a9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:45.939900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74839aa7-ffac-454c-8a52-0c4075a63dd4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:45.941510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 45/88] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:45 2022] GET /identity/v3/users/b8d6cc1775b14b0db17609fec02d67a9 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:45.942274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74839aa7-ffac-454c-8a52-0c4075a63dd4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:45.959134 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:45.980541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e28035-109f-42c2-9fcb-ddcb7175ec17 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:46.015211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e879420-e97b-4fc4-bbbe-942b9e42e64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:46.015862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e879420-e97b-4fc4-bbbe-942b9e42e64d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:46.016150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e879420-e97b-4fc4-bbbe-942b9e42e64d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:46.016431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e879420-e97b-4fc4-bbbe-942b9e42e64d None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:46.018090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e879420-e97b-4fc4-bbbe-942b9e42e64d None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:46.019572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e879420-e97b-4fc4-bbbe-942b9e42e64d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:46.021275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 44/89] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:45 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:46.022015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e879420-e97b-4fc4-bbbe-942b9e42e64d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:46.044347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74839aa7-ffac-454c-8a52-0c4075a63dd4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:46.078612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e5c13-ba9e-4b20-8866-202fdd7b23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:46.079270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e5c13-ba9e-4b20-8866-202fdd7b23cd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:46.080080 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e5c13-ba9e-4b20-8866-202fdd7b23cd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:46.080355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e5c13-ba9e-4b20-8866-202fdd7b23cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:46.081167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e5c13-ba9e-4b20-8866-202fdd7b23cd None admin] RBAC: Adding query filter params (role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=bfc55faa34394f559d12491d3fb33989, user.id=b8d6cc1775b14b0db17609fec02d67a9) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:46.081480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e5c13-ba9e-4b20-8866-202fdd7b23cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:46.082961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e5c13-ba9e-4b20-8866-202fdd7b23cd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:46.088282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 46/90] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:45 2022] GET /identity/v3/role_assignments?user.id=b8d6cc1775b14b0db17609fec02d67a9&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:46.089047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e5c13-ba9e-4b20-8866-202fdd7b23cd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:46.089942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:46.129884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e879420-e97b-4fc4-bbbe-942b9e42e64d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:46.169918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e981b-2f85-4ce7-87f3-b9f376fe83bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:46.170756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e981b-2f85-4ce7-87f3-b9f376fe83bd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:46.171141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e981b-2f85-4ce7-87f3-b9f376fe83bd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:46.171384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e981b-2f85-4ce7-87f3-b9f376fe83bd None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:46.172688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e981b-2f85-4ce7-87f3-b9f376fe83bd None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:46.174717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e981b-2f85-4ce7-87f3-b9f376fe83bd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:46.181482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 45/91] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:46 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:46.181482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e981b-2f85-4ce7-87f3-b9f376fe83bd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:46.186314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:46.212494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e5c13-ba9e-4b20-8866-202fdd7b23cd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:46.256703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f8cda-2a50-410d-9c87-d4b2b0d5a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:46.257264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f8cda-2a50-410d-9c87-d4b2b0d5a608 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:46.257550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f8cda-2a50-410d-9c87-d4b2b0d5a608 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:46.257824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f8cda-2a50-410d-9c87-d4b2b0d5a608 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:46.258527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f8cda-2a50-410d-9c87-d4b2b0d5a608 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:46.260282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f8cda-2a50-410d-9c87-d4b2b0d5a608 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:46.294918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 47/92] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:35:46 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:46.294918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f8cda-2a50-410d-9c87-d4b2b0d5a608 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:46.308620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e981b-2f85-4ce7-87f3-b9f376fe83bd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:46.356549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0bfb-2805-4db1-a4d7-a38beb40fa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:46.357288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0bfb-2805-4db1-a4d7-a38beb40fa6f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:46.357640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0bfb-2805-4db1-a4d7-a38beb40fa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:46.358048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0bfb-2805-4db1-a4d7-a38beb40fa6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:46.363929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:46.434186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f8cda-2a50-410d-9c87-d4b2b0d5a608 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:46.466356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e0bfb-2805-4db1-a4d7-a38beb40fa6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:46.468220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e0bfb-2805-4db1-a4d7-a38beb40fa6f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:46.485372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af441-2d99-41d3-83a7-6dc278e546ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:46.486575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af441-2d99-41d3-83a7-6dc278e546ed None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:46.486867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af441-2d99-41d3-83a7-6dc278e546ed None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:46.487213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af441-2d99-41d3-83a7-6dc278e546ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:46.488326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af441-2d99-41d3-83a7-6dc278e546ed None admin] RBAC: Adding query filter params (role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=bfc55faa34394f559d12491d3fb33989, user.id=b8d6cc1775b14b0db17609fec02d67a9) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:46.488655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af441-2d99-41d3-83a7-6dc278e546ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:46.491034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af441-2d99-41d3-83a7-6dc278e546ed None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:46.493923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:46.500354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 48/93] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:46 2022] GET /identity/v3/role_assignments?user.id=b8d6cc1775b14b0db17609fec02d67a9&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:46.501650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af441-2d99-41d3-83a7-6dc278e546ed None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:46.614657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 46/94] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:46.620773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0bfb-2805-4db1-a4d7-a38beb40fa6f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:46.666824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af441-2d99-41d3-83a7-6dc278e546ed None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:46.673863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:46.714438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677e53-b0cd-4172-b542-84aa03f23534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:46.715164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677e53-b0cd-4172-b542-84aa03f23534 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:46.715485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677e53-b0cd-4172-b542-84aa03f23534 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:46.715900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677e53-b0cd-4172-b542-84aa03f23534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:46.717219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677e53-b0cd-4172-b542-84aa03f23534 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=bfc55faa34394f559d12491d3fb33989, user.id=0d288edc5a024ebe8b9e0a02e9598b35) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:46.717553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677e53-b0cd-4172-b542-84aa03f23534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:46.719372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677e53-b0cd-4172-b542-84aa03f23534 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:46.726785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 49/95] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:46 2022] GET /identity/v3/role_assignments?user.id=0d288edc5a024ebe8b9e0a02e9598b35&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=2ba3b2926541436a9d26782420538af3 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:46.766630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0bfb-2805-4db1-a4d7-a38beb40fa6f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:46.811170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e4dbe-e596-4551-852d-b250e984f374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:46.811857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e4dbe-e596-4551-852d-b250e984f374 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:46.812144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e4dbe-e596-4551-852d-b250e984f374 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:46.812427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e4dbe-e596-4551-852d-b250e984f374 None admin] PATH_INFO: `/v3/projects/9523f199c8c742e7830fb7fafcd1861e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:46.815230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e4dbe-e596-4551-852d-b250e984f374 None admin] RBAC: Authorizing `identity:get_project(project_id=9523f199c8c742e7830fb7fafcd1861e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:46.815521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e4dbe-e596-4551-852d-b250e984f374 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:46.817458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 47/96] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:46 2022] GET /identity/v3/projects/9523f199c8c742e7830fb7fafcd1861e => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:46.823952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677e53-b0cd-4172-b542-84aa03f23534 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:46.897134 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:46.941747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677e53-b0cd-4172-b542-84aa03f23534 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:46.977317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9da80-2c6e-4e17-83ce-5da94f3a3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:46.977949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9da80-2c6e-4e17-83ce-5da94f3a3e06 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:46.978235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9da80-2c6e-4e17-83ce-5da94f3a3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:46.978512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9da80-2c6e-4e17-83ce-5da94f3a3e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:46.979362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9da80-2c6e-4e17-83ce-5da94f3a3e06 None admin] RBAC: Adding query filter params (role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=9523f199c8c742e7830fb7fafcd1861e, user.id=b8d6cc1775b14b0db17609fec02d67a9) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:46.979674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9da80-2c6e-4e17-83ce-5da94f3a3e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:46.981137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9da80-2c6e-4e17-83ce-5da94f3a3e06 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:46.987737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 50/97] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:46 2022] GET /identity/v3/role_assignments?user.id=b8d6cc1775b14b0db17609fec02d67a9&scope.project.id=9523f199c8c742e7830fb7fafcd1861e&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:48.844284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4d3a-674d-4690-b06b-cba833efa7c8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:48.845721 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4d3a-674d-4690-b06b-cba833efa7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:48.846787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4d3a-674d-4690-b06b-cba833efa7c8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:48.849584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 48/98] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:48.857745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd0a0a-e557-49f7-93a0-b910fab0803f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:48.858971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd0a0a-e557-49f7-93a0-b910fab0803f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:48.859650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd0a0a-e557-49f7-93a0-b910fab0803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:48.888126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-38fd0a0a-e557-49f7-93a0-b910fab0803f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:48.889720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-38fd0a0a-e557-49f7-93a0-b910fab0803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:48.963403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 51/99] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:49.009087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a4d3a-674d-4690-b06b-cba833efa7c8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:49.117122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a46c15-d9f7-44e6-b769-fbeb5d6351d0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.118173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a46c15-d9f7-44e6-b769-fbeb5d6351d0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.118741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a46c15-d9f7-44e6-b769-fbeb5d6351d0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.120908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 52/100] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:35:49.126770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c368c-24f6-465b-a5f9-a903e19f792e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.127319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c368c-24f6-465b-a5f9-a903e19f792e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.127792 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c368c-24f6-465b-a5f9-a903e19f792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.148579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a4d3a-674d-4690-b06b-cba833efa7c8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:49.151301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:49.171994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a59c368c-24f6-465b-a5f9-a903e19f792e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:49.173593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a59c368c-24f6-465b-a5f9-a903e19f792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:49.196148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0f2ba-687f-4735-b489-cbc34a0781ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:49.197006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0f2ba-687f-4735-b489-cbc34a0781ff None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.197301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0f2ba-687f-4735-b489-cbc34a0781ff None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.197584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0f2ba-687f-4735-b489-cbc34a0781ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.211118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0f2ba-687f-4735-b489-cbc34a0781ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-cff0f2ba-687f-4735-b489-cbc34a0781ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:49.217924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:49.219796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:49.221873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 49/101] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:49.224687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0f2ba-687f-4735-b489-cbc34a0781ff None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:49.330516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0f2ba-687f-4735-b489-cbc34a0781ff None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:49.335996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:49.371212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbb1ed-40b6-461b-a017-826af92fcce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:49.371755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbb1ed-40b6-461b-a017-826af92fcce4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.372054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbb1ed-40b6-461b-a017-826af92fcce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.372313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbb1ed-40b6-461b-a017-826af92fcce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.373111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbb1ed-40b6-461b-a017-826af92fcce4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:49.373433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbb1ed-40b6-461b-a017-826af92fcce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:49.374873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbb1ed-40b6-461b-a017-826af92fcce4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:49.384607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 50/102] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:35:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:49.390087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbb1ed-40b6-461b-a017-826af92fcce4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:49.396501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 53/103] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:49.439620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:49.445778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c368c-24f6-465b-a5f9-a903e19f792e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:49.521087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbb1ed-40b6-461b-a017-826af92fcce4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:49.559563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e114-095e-4a32-ab9e-98185bb0ef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:49.560221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e114-095e-4a32-ab9e-98185bb0ef83 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.560506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e114-095e-4a32-ab9e-98185bb0ef83 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.560782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e114-095e-4a32-ab9e-98185bb0ef83 None admin] PATH_INFO: `/v3/users/b8d6cc1775b14b0db17609fec02d67a9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.562658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627e114-095e-4a32-ab9e-98185bb0ef83 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d6cc1775b14b0db17609fec02d67a9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:49.564211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627e114-095e-4a32-ab9e-98185bb0ef83 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:49.568878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 51/104] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:49 2022] GET /identity/v3/users/b8d6cc1775b14b0db17609fec02d67a9 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:35:49.576224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e114-095e-4a32-ab9e-98185bb0ef83 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:49.643358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c368c-24f6-465b-a5f9-a903e19f792e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:49.699282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:49.702669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e114-095e-4a32-ab9e-98185bb0ef83 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:49.738197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee1a1a-0773-4b38-8897-3ba748345aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:49.738854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee1a1a-0773-4b38-8897-3ba748345aec None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.739156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee1a1a-0773-4b38-8897-3ba748345aec None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.739432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee1a1a-0773-4b38-8897-3ba748345aec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.743574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c513b-10d4-418c-90e9-ab202ce0256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:49.744289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c513b-10d4-418c-90e9-ab202ce0256c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.744723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c513b-10d4-418c-90e9-ab202ce0256c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.745165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c513b-10d4-418c-90e9-ab202ce0256c None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.746426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c513b-10d4-418c-90e9-ab202ce0256c None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:49.748450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c513b-10d4-418c-90e9-ab202ce0256c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:49.750732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 52/105] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:49 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:49.750879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee1a1a-0773-4b38-8897-3ba748345aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:49.751795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459a491-ca48-4615-88bf-cf61688d6a6f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.752081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459a491-ca48-4615-88bf-cf61688d6a6f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.752359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459a491-ca48-4615-88bf-cf61688d6a6f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.753740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 53/106] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:49.754618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a821a-6ad6-4a3f-b490-cbf790fec624 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.754919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a821a-6ad6-4a3f-b490-cbf790fec624 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.759773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a821a-6ad6-4a3f-b490-cbf790fec624 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-feee1a1a-0773-4b38-8897-3ba748345aec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:49.760614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:49.761612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:35:49.762539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:35:49.763272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 54/107] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:49.763272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6963-5aac-4de9-9381-3b937000a4ac None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.763272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6963-5aac-4de9-9381-3b937000a4ac None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.763272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6963-5aac-4de9-9381-3b937000a4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.764620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 54/108] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:49.768285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee1a1a-0773-4b38-8897-3ba748345aec None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:49.791430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-304b6963-5aac-4de9-9381-3b937000a4ac None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:49.793334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-304b6963-5aac-4de9-9381-3b937000a4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:49.824109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:49.878437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 55/109] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:49.879230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6963-5aac-4de9-9381-3b937000a4ac None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:49.897672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee1a1a-0773-4b38-8897-3ba748345aec None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:49.944007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbd00a-2154-47e8-96a1-c4ad1b3d8cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:49.944876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbd00a-2154-47e8-96a1-c4ad1b3d8cc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.945256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbd00a-2154-47e8-96a1-c4ad1b3d8cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.945627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbd00a-2154-47e8-96a1-c4ad1b3d8cc9 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989/users/b8d6cc1775b14b0db17609fec02d67a9/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.947949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbd00a-2154-47e8-96a1-c4ad1b3d8cc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc55faa34394f559d12491d3fb33989, user_id=b8d6cc1775b14b0db17609fec02d67a9, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:49.949788 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbd00a-2154-47e8-96a1-c4ad1b3d8cc9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:49.968295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 55/110] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:35:49 2022] PUT /identity/v3/projects/bfc55faa34394f559d12491d3fb33989/users/b8d6cc1775b14b0db17609fec02d67a9/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:35:49.969857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fdf0-9cb0-4f6c-828d-890cc18c0d45 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:49.970422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fdf0-9cb0-4f6c-828d-890cc18c0d45 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:49.970799 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fdf0-9cb0-4f6c-828d-890cc18c0d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:49.994154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-99c6fdf0-9cb0-4f6c-828d-890cc18c0d45 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:49.995607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-99c6fdf0-9cb0-4f6c-828d-890cc18c0d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:49.997532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:50.017624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6963-5aac-4de9-9381-3b937000a4ac None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:50.084532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 56/111] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:50.085440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6fdf0-9cb0-4f6c-828d-890cc18c0d45 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.117495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c856864-8fca-48e1-9d4d-a54914b7ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:50.119091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856864-8fca-48e1-9d4d-a54914b7ccec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.119371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856864-8fca-48e1-9d4d-a54914b7ccec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.119645 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856864-8fca-48e1-9d4d-a54914b7ccec None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.120734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c856864-8fca-48e1-9d4d-a54914b7ccec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:50.121046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c856864-8fca-48e1-9d4d-a54914b7ccec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:50.122523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c856864-8fca-48e1-9d4d-a54914b7ccec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:50.133394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 56/112] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:35:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:50.139068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc98ae-7c7c-48fa-a85c-75b0b7f4e733 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.139068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc98ae-7c7c-48fa-a85c-75b0b7f4e733 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.139068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc98ae-7c7c-48fa-a85c-75b0b7f4e733 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.139068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 57/113] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:50.139068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc98ae-7c7c-48fa-a85c-75b0b7f4e733 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.152498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:50.228066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6fdf0-9cb0-4f6c-828d-890cc18c0d45 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:50.264648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa301-0646-41a9-8ae6-dc526f0ae0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:50.265685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa301-0646-41a9-8ae6-dc526f0ae0ee None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.266144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc98ae-7c7c-48fa-a85c-75b0b7f4e733 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:50.266413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa301-0646-41a9-8ae6-dc526f0ae0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.266918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa301-0646-41a9-8ae6-dc526f0ae0ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.279602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fa301-0646-41a9-8ae6-dc526f0ae0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d80fa301-0646-41a9-8ae6-dc526f0ae0ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:50.285463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:50.286284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:50.287090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:35:50.292886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 57/114] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:50.292886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa301-0646-41a9-8ae6-dc526f0ae0ee None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.307931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6263f3-61f5-490f-8fd1-65f26ba5e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:50.308570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6263f3-61f5-490f-8fd1-65f26ba5e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.308855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6263f3-61f5-490f-8fd1-65f26ba5e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.309126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6263f3-61f5-490f-8fd1-65f26ba5e5e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.320490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6263f3-61f5-490f-8fd1-65f26ba5e5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2f6263f3-61f5-490f-8fd1-65f26ba5e5e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:50.325884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:50.326724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:50.327597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 58/115] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:50.328246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262271-72fd-433b-8d2b-40bd860e48cd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.334187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262271-72fd-433b-8d2b-40bd860e48cd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.334187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262271-72fd-433b-8d2b-40bd860e48cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.349160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-14262271-72fd-433b-8d2b-40bd860e48cd None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:50.350351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-14262271-72fd-433b-8d2b-40bd860e48cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:50.361196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:50.399428 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:50.407454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa301-0646-41a9-8ae6-dc526f0ae0ee None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:50.433197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 59/116] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:50.433197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb078a1-6abc-44ca-9999-10680099eb77 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.433197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb078a1-6abc-44ca-9999-10680099eb77 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.433197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb078a1-6abc-44ca-9999-10680099eb77 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.433197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 60/117] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:50.433197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb078a1-6abc-44ca-9999-10680099eb77 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.459319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad1070-c994-49e5-9be0-05b41c2485d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:50.459978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1070-c994-49e5-9be0-05b41c2485d1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.460262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1070-c994-49e5-9be0-05b41c2485d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.460536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1070-c994-49e5-9be0-05b41c2485d1 None admin] PATH_INFO: `/v3/users/b8d6cc1775b14b0db17609fec02d67a9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.461952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad1070-c994-49e5-9be0-05b41c2485d1 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d6cc1775b14b0db17609fec02d67a9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:50.463246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad1070-c994-49e5-9be0-05b41c2485d1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:50.465026 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 58/118] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/users/b8d6cc1775b14b0db17609fec02d67a9 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:50.469520 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad1070-c994-49e5-9be0-05b41c2485d1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.553225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb078a1-6abc-44ca-9999-10680099eb77 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:50.569562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad1070-c994-49e5-9be0-05b41c2485d1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:50.589918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449255-29fd-4266-827e-3bd59b66bee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:50.590610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449255-29fd-4266-827e-3bd59b66bee3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.591346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449255-29fd-4266-827e-3bd59b66bee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.591635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449255-29fd-4266-827e-3bd59b66bee3 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.592521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449255-29fd-4266-827e-3bd59b66bee3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:50.592828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449255-29fd-4266-827e-3bd59b66bee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:50.594239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449255-29fd-4266-827e-3bd59b66bee3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:50.603135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 61/119] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:50.604308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45534ed4-2a99-4c98-9dba-73958af4a888 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.604601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45534ed4-2a99-4c98-9dba-73958af4a888 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.604875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45534ed4-2a99-4c98-9dba-73958af4a888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.608933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6543b5-7681-484e-8602-f8971df7bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:50.609918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6543b5-7681-484e-8602-f8971df7bc64 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.610394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6543b5-7681-484e-8602-f8971df7bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.611666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6543b5-7681-484e-8602-f8971df7bc64 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.613547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6543b5-7681-484e-8602-f8971df7bc64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:50.614055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6543b5-7681-484e-8602-f8971df7bc64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:50.615693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6543b5-7681-484e-8602-f8971df7bc64 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:50.619159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:50.624550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-45534ed4-2a99-4c98-9dba-73958af4a888 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:50.626526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-45534ed4-2a99-4c98-9dba-73958af4a888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:50.627827 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 59/120] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:50.629104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6543b5-7681-484e-8602-f8971df7bc64 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.661751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:50.703738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 62/121] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:50.715105 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45534ed4-2a99-4c98-9dba-73958af4a888 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.751105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6543b5-7681-484e-8602-f8971df7bc64 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:50.788308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945db8e3-2f02-4803-bc04-6c0fcf2ab79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:50.789097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db8e3-2f02-4803-bc04-6c0fcf2ab79a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.789382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db8e3-2f02-4803-bc04-6c0fcf2ab79a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.789654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db8e3-2f02-4803-bc04-6c0fcf2ab79a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.790870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945db8e3-2f02-4803-bc04-6c0fcf2ab79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:50.792359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945db8e3-2f02-4803-bc04-6c0fcf2ab79a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:50.799268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 60/122] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:50.800002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945db8e3-2f02-4803-bc04-6c0fcf2ab79a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.821242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45534ed4-2a99-4c98-9dba-73958af4a888 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:50.862054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5214bb7-b4be-4807-b84b-cf973842b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:50.862701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5214bb7-b4be-4807-b84b-cf973842b3bc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.863012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5214bb7-b4be-4807-b84b-cf973842b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.863287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5214bb7-b4be-4807-b84b-cf973842b3bc None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.864464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5214bb7-b4be-4807-b84b-cf973842b3bc None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:50.865919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5214bb7-b4be-4807-b84b-cf973842b3bc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:50.867624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 63/123] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:50.868386 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5214bb7-b4be-4807-b84b-cf973842b3bc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.875885 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:50.905014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:50.916395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945db8e3-2f02-4803-bc04-6c0fcf2ab79a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:50.955407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f3dd9-45a4-4f25-8ee7-fb6b8ecbe5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:50.956444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f3dd9-45a4-4f25-8ee7-fb6b8ecbe5cd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:50.956743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f3dd9-45a4-4f25-8ee7-fb6b8ecbe5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:50.957056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f3dd9-45a4-4f25-8ee7-fb6b8ecbe5cd None admin] PATH_INFO: `/v3/users/b8d6cc1775b14b0db17609fec02d67a9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:50.958267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f3dd9-45a4-4f25-8ee7-fb6b8ecbe5cd None admin] RBAC: Authorizing `identity:get_user(user_id=b8d6cc1775b14b0db17609fec02d67a9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:50.959746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f3dd9-45a4-4f25-8ee7-fb6b8ecbe5cd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:50.961348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 61/124] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/users/b8d6cc1775b14b0db17609fec02d67a9 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:50.962108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f3dd9-45a4-4f25-8ee7-fb6b8ecbe5cd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:50.983695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5214bb7-b4be-4807-b84b-cf973842b3bc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.020402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd91a4-8d5b-455a-8629-352fb66e6260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:51.021143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd91a4-8d5b-455a-8629-352fb66e6260 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:51.021432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd91a4-8d5b-455a-8629-352fb66e6260 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:51.021709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd91a4-8d5b-455a-8629-352fb66e6260 None admin] PATH_INFO: `/v3/users/d9e7dc500be34136abb21c481f2ecc4f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:51.036091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd91a4-8d5b-455a-8629-352fb66e6260 None admin] RBAC: Authorizing `identity:get_user(user_id=d9e7dc500be34136abb21c481f2ecc4f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:51.037554 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd91a4-8d5b-455a-8629-352fb66e6260 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:51.043618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 64/125] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/users/d9e7dc500be34136abb21c481f2ecc4f => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:51.043618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd91a4-8d5b-455a-8629-352fb66e6260 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:51.071583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f3dd9-45a4-4f25-8ee7-fb6b8ecbe5cd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.108274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e92e7-1170-48a5-b5df-0a06f6e93a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:51.109263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e92e7-1170-48a5-b5df-0a06f6e93a68 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:51.109749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e92e7-1170-48a5-b5df-0a06f6e93a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:51.110124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e92e7-1170-48a5-b5df-0a06f6e93a68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:51.113072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:51.122007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e92e7-1170-48a5-b5df-0a06f6e93a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-959e92e7-1170-48a5-b5df-0a06f6e93a68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:51.128038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:51.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:35:51.129685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 62/126] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:51.130323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e92e7-1170-48a5-b5df-0a06f6e93a68 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:51.159279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:51.160194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd91a4-8d5b-455a-8629-352fb66e6260 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.197428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6db1a3-6717-4698-90a4-f15bc170e75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:51.197973 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6db1a3-6717-4698-90a4-f15bc170e75f None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:51.198262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6db1a3-6717-4698-90a4-f15bc170e75f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:51.198538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6db1a3-6717-4698-90a4-f15bc170e75f None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:51.199265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6db1a3-6717-4698-90a4-f15bc170e75f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:51.200720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6db1a3-6717-4698-90a4-f15bc170e75f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:51.229630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 65/127] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:35:51 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:51.230571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6db1a3-6717-4698-90a4-f15bc170e75f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:51.264641 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e92e7-1170-48a5-b5df-0a06f6e93a68 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.319675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6db75-ba9b-4b6b-8657-1aacad0fb198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:51.321290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6db75-ba9b-4b6b-8657-1aacad0fb198 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:51.321897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6db75-ba9b-4b6b-8657-1aacad0fb198 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:51.322354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6db75-ba9b-4b6b-8657-1aacad0fb198 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989/users/b8d6cc1775b14b0db17609fec02d67a9/roles/d37aa78d5c9d411886137e9cdff24857` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:51.325234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6db75-ba9b-4b6b-8657-1aacad0fb198 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc55faa34394f559d12491d3fb33989, user_id=b8d6cc1775b14b0db17609fec02d67a9, role_id=d37aa78d5c9d411886137e9cdff24857)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:51.327820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6db75-ba9b-4b6b-8657-1aacad0fb198 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:51.354924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 63/128] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:35:51 2022] PUT /identity/v3/projects/bfc55faa34394f559d12491d3fb33989/users/b8d6cc1775b14b0db17609fec02d67a9/roles/d37aa78d5c9d411886137e9cdff24857 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:35:51.354924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6db75-ba9b-4b6b-8657-1aacad0fb198 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:51.397551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6db1a3-6717-4698-90a4-f15bc170e75f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.415228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:51.467307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465f481-e920-41d6-ba92-b1a6991c05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:51.467900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465f481-e920-41d6-ba92-b1a6991c05d3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:51.468184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465f481-e920-41d6-ba92-b1a6991c05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:51.468465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465f481-e920-41d6-ba92-b1a6991c05d3 None admin] PATH_INFO: `/v3/projects/9523f199c8c742e7830fb7fafcd1861e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:51.469850 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465f481-e920-41d6-ba92-b1a6991c05d3 None admin] RBAC: Authorizing `identity:get_project(project_id=9523f199c8c742e7830fb7fafcd1861e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:51.471817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465f481-e920-41d6-ba92-b1a6991c05d3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:51.473902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 66/129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:51 2022] GET /identity/v3/projects/9523f199c8c742e7830fb7fafcd1861e => generated 312 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:51.475757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465f481-e920-41d6-ba92-b1a6991c05d3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:51.490667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:51.513650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6db75-ba9b-4b6b-8657-1aacad0fb198 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.566056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad51d8-1754-40fa-94a0-733cc564690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:51.567506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad51d8-1754-40fa-94a0-733cc564690d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:51.567506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad51d8-1754-40fa-94a0-733cc564690d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:51.567506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad51d8-1754-40fa-94a0-733cc564690d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:51.614016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465f481-e920-41d6-ba92-b1a6991c05d3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.657101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c3610-8b1c-44d1-9fa2-6c096f7755f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:51.658257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c3610-8b1c-44d1-9fa2-6c096f7755f1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:51.658544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c3610-8b1c-44d1-9fa2-6c096f7755f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:51.658822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c3610-8b1c-44d1-9fa2-6c096f7755f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:51.659769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c3610-8b1c-44d1-9fa2-6c096f7755f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:51.660084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c3610-8b1c-44d1-9fa2-6c096f7755f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:51.661504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c3610-8b1c-44d1-9fa2-6c096f7755f1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:51.666837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad51d8-1754-40fa-94a0-733cc564690d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:51.668424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad51d8-1754-40fa-94a0-733cc564690d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:51.670961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 67/130] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:51.671720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c3610-8b1c-44d1-9fa2-6c096f7755f1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:51.721970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:51.758204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:51.780265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 64/131] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:51.781202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad51d8-1754-40fa-94a0-733cc564690d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:51.783975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c3610-8b1c-44d1-9fa2-6c096f7755f1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.821088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cd51d-da2c-4e68-8143-7520adfa0d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:51.821780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cd51d-da2c-4e68-8143-7520adfa0d0a None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:51.822067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cd51d-da2c-4e68-8143-7520adfa0d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:51.822345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cd51d-da2c-4e68-8143-7520adfa0d0a None admin] PATH_INFO: `/v3/projects/9523f199c8c742e7830fb7fafcd1861e/users/b8d6cc1775b14b0db17609fec02d67a9/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:51.824425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cd51d-da2c-4e68-8143-7520adfa0d0a None admin] RBAC: Authorizing `identity:create_grant(project_id=9523f199c8c742e7830fb7fafcd1861e, user_id=b8d6cc1775b14b0db17609fec02d67a9, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:51.825913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cd51d-da2c-4e68-8143-7520adfa0d0a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:51.842366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 68/132] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:35:51 2022] PUT /identity/v3/projects/9523f199c8c742e7830fb7fafcd1861e/users/b8d6cc1775b14b0db17609fec02d67a9/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:35:51.843369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cd51d-da2c-4e68-8143-7520adfa0d0a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:51.900813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad51d8-1754-40fa-94a0-733cc564690d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.937474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd68d5-5951-4eb8-bd8b-f42f36f834c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:51.938237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd68d5-5951-4eb8-bd8b-f42f36f834c1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:51.938473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd68d5-5951-4eb8-bd8b-f42f36f834c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:51.939342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd68d5-5951-4eb8-bd8b-f42f36f834c1 None admin] PATH_INFO: `/v3/users/0d288edc5a024ebe8b9e0a02e9598b35` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:51.940625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd68d5-5951-4eb8-bd8b-f42f36f834c1 None admin] RBAC: Authorizing `identity:get_user(user_id=0d288edc5a024ebe8b9e0a02e9598b35)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:51.942135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd68d5-5951-4eb8-bd8b-f42f36f834c1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:51.944299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 65/133] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:51 2022] GET /identity/v3/users/0d288edc5a024ebe8b9e0a02e9598b35 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:51.951595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd68d5-5951-4eb8-bd8b-f42f36f834c1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:51.967847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cd51d-da2c-4e68-8143-7520adfa0d0a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:51.970908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:52.012245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaca8c-6b5a-42d9-bd41-4a1fc5a5f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:52.012963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaca8c-6b5a-42d9-bd41-4a1fc5a5f6af None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:52.013143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaca8c-6b5a-42d9-bd41-4a1fc5a5f6af None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:52.018225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaca8c-6b5a-42d9-bd41-4a1fc5a5f6af None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:52.018225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beaca8c-6b5a-42d9-bd41-4a1fc5a5f6af None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:52.018225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beaca8c-6b5a-42d9-bd41-4a1fc5a5f6af None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:52.018225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 69/134] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:51 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:52.030924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaca8c-6b5a-42d9-bd41-4a1fc5a5f6af None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:52.056230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:52.154962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaca8c-6b5a-42d9-bd41-4a1fc5a5f6af None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:52.189369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd68d5-5951-4eb8-bd8b-f42f36f834c1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:52.193120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5b1a5-5886-4ef8-b2f6-0568744aedbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:52.193120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5b1a5-5886-4ef8-b2f6-0568744aedbd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:52.193346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5b1a5-5886-4ef8-b2f6-0568744aedbd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:52.193548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5b1a5-5886-4ef8-b2f6-0568744aedbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:52.194350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5b1a5-5886-4ef8-b2f6-0568744aedbd None admin] RBAC: Adding query filter params (role.id=a7b8a3f8aa3a461782f12e263408b403, scope.project.id=bfc55faa34394f559d12491d3fb33989, user.id=d9e7dc500be34136abb21c481f2ecc4f) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:52.194690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5b1a5-5886-4ef8-b2f6-0568744aedbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:52.196211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5b1a5-5886-4ef8-b2f6-0568744aedbd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:52.204877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 70/135] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:52 2022] GET /identity/v3/role_assignments?user.id=d9e7dc500be34136abb21c481f2ecc4f&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=a7b8a3f8aa3a461782f12e263408b403 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:52.277930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df0a5-9708-474d-bf26-bc0b36068e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:52.279004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df0a5-9708-474d-bf26-bc0b36068e6c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:52.279531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df0a5-9708-474d-bf26-bc0b36068e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:52.280026 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df0a5-9708-474d-bf26-bc0b36068e6c None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:52.287904 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df0a5-9708-474d-bf26-bc0b36068e6c None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:52.289793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df0a5-9708-474d-bf26-bc0b36068e6c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:52.292019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 66/136] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:51 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:52.298772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5b1a5-5886-4ef8-b2f6-0568744aedbd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:52.359292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:52.402000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba4fc-8440-4438-b37d-a7282511ba6f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:52.402625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba4fc-8440-4438-b37d-a7282511ba6f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:52.403139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba4fc-8440-4438-b37d-a7282511ba6f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:52.404950 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 67/137] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:52.416359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d291a-0cd6-4f1c-afaf-dfcceb5afa50 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:52.416993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d291a-0cd6-4f1c-afaf-dfcceb5afa50 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:52.417479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d291a-0cd6-4f1c-afaf-dfcceb5afa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:52.458924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5b1a5-5886-4ef8-b2f6-0568744aedbd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:52.472266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a45d291a-0cd6-4f1c-afaf-dfcceb5afa50 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:52.473851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a45d291a-0cd6-4f1c-afaf-dfcceb5afa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:52.493091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a79d6-f851-4125-844d-cd5c565aa377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:52.493786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a79d6-f851-4125-844d-cd5c565aa377 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:52.494074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a79d6-f851-4125-844d-cd5c565aa377 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:52.494354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a79d6-f851-4125-844d-cd5c565aa377 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989/users/0d288edc5a024ebe8b9e0a02e9598b35/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:52.498913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a79d6-f851-4125-844d-cd5c565aa377 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc55faa34394f559d12491d3fb33989, user_id=0d288edc5a024ebe8b9e0a02e9598b35, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:52.498913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a79d6-f851-4125-844d-cd5c565aa377 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:52.517892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 71/138] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:35:52 2022] PUT /identity/v3/projects/bfc55faa34394f559d12491d3fb33989/users/0d288edc5a024ebe8b9e0a02e9598b35/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:35:52.589214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 68/139] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:35:52.625437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a79d6-f851-4125-844d-cd5c565aa377 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:52.731308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:52.737932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a79d6-f851-4125-844d-cd5c565aa377 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:52.776315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf50c-3ef1-47e0-a0cc-0f1ef1355aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:52.776976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf50c-3ef1-47e0-a0cc-0f1ef1355aba None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:52.777267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf50c-3ef1-47e0-a0cc-0f1ef1355aba None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:52.777559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf50c-3ef1-47e0-a0cc-0f1ef1355aba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:52.790218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbf50c-3ef1-47e0-a0cc-0f1ef1355aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-33dbf50c-3ef1-47e0-a0cc-0f1ef1355aba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:52.797027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:52.798620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:52.799542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 72/140] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:52.807007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d291a-0cd6-4f1c-afaf-dfcceb5afa50 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:52.859000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:52.926282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d291a-0cd6-4f1c-afaf-dfcceb5afa50 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:52.961498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94c8e-6e74-4a00-aba7-b871d414c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:52.962276 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94c8e-6e74-4a00-aba7-b871d414c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:52.962444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94c8e-6e74-4a00-aba7-b871d414c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:52.962658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94c8e-6e74-4a00-aba7-b871d414c9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:52.963411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a94c8e-6e74-4a00-aba7-b871d414c9d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:52.963712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a94c8e-6e74-4a00-aba7-b871d414c9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:52.965166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a94c8e-6e74-4a00-aba7-b871d414c9d5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:52.976157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 69/141] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:35:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:52.983163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf50c-3ef1-47e0-a0cc-0f1ef1355aba None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:53.088134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf50c-3ef1-47e0-a0cc-0f1ef1355aba None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:53.123946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad268075-a5db-419e-9e87-1fd122d755df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:53.124527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad268075-a5db-419e-9e87-1fd122d755df None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:53.124859 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad268075-a5db-419e-9e87-1fd122d755df None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:53.125196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad268075-a5db-419e-9e87-1fd122d755df None admin] PATH_INFO: `/v3/users/b8d6cc1775b14b0db17609fec02d67a9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:53.127089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad268075-a5db-419e-9e87-1fd122d755df None admin] RBAC: Authorizing `identity:get_user(user_id=b8d6cc1775b14b0db17609fec02d67a9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:53.128636 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad268075-a5db-419e-9e87-1fd122d755df None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:53.134484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 73/142] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:52 2022] GET /identity/v3/users/b8d6cc1775b14b0db17609fec02d67a9 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:53.136684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94c8e-6e74-4a00-aba7-b871d414c9d5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:53.258636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94c8e-6e74-4a00-aba7-b871d414c9d5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:53.270512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:53.311747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b95b9c-49eb-4d26-a48e-4c6cb82a0d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:53.312945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b95b9c-49eb-4d26-a48e-4c6cb82a0d71 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:53.313221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b95b9c-49eb-4d26-a48e-4c6cb82a0d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:53.313496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b95b9c-49eb-4d26-a48e-4c6cb82a0d71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:53.397969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b95b9c-49eb-4d26-a48e-4c6cb82a0d71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:53.401375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b95b9c-49eb-4d26-a48e-4c6cb82a0d71 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:53.531661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 70/143] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:53.537350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad268075-a5db-419e-9e87-1fd122d755df None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:53.574210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:53.670708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad268075-a5db-419e-9e87-1fd122d755df None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:53.711062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b62b9f-26ac-419c-8c67-37561000aa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:53.711710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62b9f-26ac-419c-8c67-37561000aa2d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:53.711972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62b9f-26ac-419c-8c67-37561000aa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:53.712246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62b9f-26ac-419c-8c67-37561000aa2d None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:53.713413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b62b9f-26ac-419c-8c67-37561000aa2d None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:53.714934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b62b9f-26ac-419c-8c67-37561000aa2d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:53.720917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 74/144] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:53 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:53.727184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b95b9c-49eb-4d26-a48e-4c6cb82a0d71 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:53.740497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:53.856517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b95b9c-49eb-4d26-a48e-4c6cb82a0d71 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:53.900645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb83cd5-ffb3-4825-b1a8-aa18496d0d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:53.901275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83cd5-ffb3-4825-b1a8-aa18496d0d97 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:53.901553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83cd5-ffb3-4825-b1a8-aa18496d0d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:53.901823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83cd5-ffb3-4825-b1a8-aa18496d0d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:53.902625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83cd5-ffb3-4825-b1a8-aa18496d0d97 None admin] RBAC: Adding query filter params (role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=bfc55faa34394f559d12491d3fb33989, user.id=b8d6cc1775b14b0db17609fec02d67a9) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:53.902953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83cd5-ffb3-4825-b1a8-aa18496d0d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:53.904398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83cd5-ffb3-4825-b1a8-aa18496d0d97 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:53.917869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 71/145] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:53 2022] GET /identity/v3/role_assignments?user.id=b8d6cc1775b14b0db17609fec02d67a9&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:54.349460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf0356-5d2c-4425-a104-52805f49c660 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:54.350467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf0356-5d2c-4425-a104-52805f49c660 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:54.350995 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf0356-5d2c-4425-a104-52805f49c660 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:54.352565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 75/146] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:54.357939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac23d29-eca3-44d7-9507-b83927c8cd82 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:54.358780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac23d29-eca3-44d7-9507-b83927c8cd82 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:54.359272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac23d29-eca3-44d7-9507-b83927c8cd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:54.383735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dac23d29-eca3-44d7-9507-b83927c8cd82 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:54.385241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dac23d29-eca3-44d7-9507-b83927c8cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:54.475011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 72/147] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:54.497516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf0356-5d2c-4425-a104-52805f49c660 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:54.519030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a4860-ce19-450b-8712-c9aec1059d00 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:54.519357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a4860-ce19-450b-8712-c9aec1059d00 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:54.519584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a4860-ce19-450b-8712-c9aec1059d00 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:54.521028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 73/148] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:35:54.526789 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242701d-5a19-406e-90c8-13049e232f34 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:54.527303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242701d-5a19-406e-90c8-13049e232f34 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:54.527709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242701d-5a19-406e-90c8-13049e232f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:54.536075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:54.548850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d242701d-5a19-406e-90c8-13049e232f34 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:54.550493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d242701d-5a19-406e-90c8-13049e232f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:54.608404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:54.622496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf0356-5d2c-4425-a104-52805f49c660 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:54.678295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1d944-ced0-4cdf-b10a-2b7d1d4ecd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:54.679588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1d944-ced0-4cdf-b10a-2b7d1d4ecd04 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:54.680694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1d944-ced0-4cdf-b10a-2b7d1d4ecd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:54.682044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1d944-ced0-4cdf-b10a-2b7d1d4ecd04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:54.686008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 74/149] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:35:54.698525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1d944-ced0-4cdf-b10a-2b7d1d4ecd04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-80d1d944-ced0-4cdf-b10a-2b7d1d4ecd04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:54.706181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:54.707344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:35:54.708293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:54.711534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 76/150] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:35:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:54.717448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242701d-5a19-406e-90c8-13049e232f34 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:54.728314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1d944-ced0-4cdf-b10a-2b7d1d4ecd04 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:54.835510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1d944-ced0-4cdf-b10a-2b7d1d4ecd04 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:54.871933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e49d6c-b334-47c2-8d72-459eff6cb260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:54.872831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e49d6c-b334-47c2-8d72-459eff6cb260 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:54.873263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e49d6c-b334-47c2-8d72-459eff6cb260 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:54.873678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e49d6c-b334-47c2-8d72-459eff6cb260 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:54.875048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e49d6c-b334-47c2-8d72-459eff6cb260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:54.876716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e49d6c-b334-47c2-8d72-459eff6cb260 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:54.878498 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 77/151] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:54.888514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e49d6c-b334-47c2-8d72-459eff6cb260 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:54.900634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242701d-5a19-406e-90c8-13049e232f34 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:54.931288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:54.957037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d4b93-635b-45c1-a6ff-e23200c17554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:54.957937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4b93-635b-45c1-a6ff-e23200c17554 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:54.958441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4b93-635b-45c1-a6ff-e23200c17554 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:54.959063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4b93-635b-45c1-a6ff-e23200c17554 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:54.959946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d4b93-635b-45c1-a6ff-e23200c17554 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:54.960394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d4b93-635b-45c1-a6ff-e23200c17554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:54.961924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d4b93-635b-45c1-a6ff-e23200c17554 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:54.963489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:54.974959 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 75/152] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:35:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:54.980332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d4b93-635b-45c1-a6ff-e23200c17554 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:55.074253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e49d6c-b334-47c2-8d72-459eff6cb260 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:55.116283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3d601-6718-4568-aa15-40d2cfef8115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:55.117331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3d601-6718-4568-aa15-40d2cfef8115 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.117822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3d601-6718-4568-aa15-40d2cfef8115 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.118291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3d601-6718-4568-aa15-40d2cfef8115 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.119259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3d601-6718-4568-aa15-40d2cfef8115 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:55.120953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3d601-6718-4568-aa15-40d2cfef8115 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:55.158401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 78/153] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:35:54 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:55.199001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d4b93-635b-45c1-a6ff-e23200c17554 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:55.239685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5b942-a87c-44e2-82d1-60d613bef0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:55.240392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5b942-a87c-44e2-82d1-60d613bef0ee None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.240675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5b942-a87c-44e2-82d1-60d613bef0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.240945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5b942-a87c-44e2-82d1-60d613bef0ee None admin] PATH_INFO: `/v3/users/b8d6cc1775b14b0db17609fec02d67a9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.242199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5b942-a87c-44e2-82d1-60d613bef0ee None admin] RBAC: Authorizing `identity:get_user(user_id=b8d6cc1775b14b0db17609fec02d67a9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:55.243793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5b942-a87c-44e2-82d1-60d613bef0ee None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:55.245636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 76/154] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:54 2022] GET /identity/v3/users/b8d6cc1775b14b0db17609fec02d67a9 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:55.249420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebf396-b4a0-471f-b3b0-3781dc13ba59 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.250214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebf396-b4a0-471f-b3b0-3781dc13ba59 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.251142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebf396-b4a0-471f-b3b0-3781dc13ba59 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.252490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5b942-a87c-44e2-82d1-60d613bef0ee None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:55.253875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 79/155] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:55.260401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17082-a467-41f3-aee6-8908399fa1ac None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.261020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17082-a467-41f3-aee6-8908399fa1ac None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.261501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17082-a467-41f3-aee6-8908399fa1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.290324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-eea17082-a467-41f3-aee6-8908399fa1ac None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:55.291847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-eea17082-a467-41f3-aee6-8908399fa1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:55.329998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:55.376238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5b942-a87c-44e2-82d1-60d613bef0ee None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:55.385757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 80/156] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:55.388171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf40470-73d2-49f2-9e33-9369cee41d7a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.389010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf40470-73d2-49f2-9e33-9369cee41d7a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.390305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf40470-73d2-49f2-9e33-9369cee41d7a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.392200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 81/157] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:55.398344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61200307-6534-4e58-9db7-33e2cae3487a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.399224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61200307-6534-4e58-9db7-33e2cae3487a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.399680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61200307-6534-4e58-9db7-33e2cae3487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.415915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:55.426495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-61200307-6534-4e58-9db7-33e2cae3487a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:55.428045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-61200307-6534-4e58-9db7-33e2cae3487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:55.438912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9485df8-cc1f-4f25-85fe-b5ff6d84bc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:55.438912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9485df8-cc1f-4f25-85fe-b5ff6d84bc55 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.438912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9485df8-cc1f-4f25-85fe-b5ff6d84bc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.438912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9485df8-cc1f-4f25-85fe-b5ff6d84bc55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.526513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 82/158] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:55.527452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61200307-6534-4e58-9db7-33e2cae3487a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:55.536958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9485df8-cc1f-4f25-85fe-b5ff6d84bc55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:55.539078 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9485df8-cc1f-4f25-85fe-b5ff6d84bc55 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:55.622584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:55.652470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61200307-6534-4e58-9db7-33e2cae3487a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:55.670088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 77/159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 07:35:55.670812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9485df8-cc1f-4f25-85fe-b5ff6d84bc55 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:55.694464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a10e61-8cd7-4c0f-8d6a-2b2a208600ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:55.695150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a10e61-8cd7-4c0f-8d6a-2b2a208600ad None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.695432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a10e61-8cd7-4c0f-8d6a-2b2a208600ad None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.695708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a10e61-8cd7-4c0f-8d6a-2b2a208600ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.698566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:55.710314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a10e61-8cd7-4c0f-8d6a-2b2a208600ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-13a10e61-8cd7-4c0f-8d6a-2b2a208600ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:55.715493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:55.716378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:55.717158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 83/160] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:55.717807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a10e61-8cd7-4c0f-8d6a-2b2a208600ad None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:55.787034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9485df8-cc1f-4f25-85fe-b5ff6d84bc55 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:55.831088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a10e61-8cd7-4c0f-8d6a-2b2a208600ad None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:55.833108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1710c9-5710-45a6-b493-6e7ae5f3081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:55.833894 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1710c9-5710-45a6-b493-6e7ae5f3081c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.834178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1710c9-5710-45a6-b493-6e7ae5f3081c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.834449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1710c9-5710-45a6-b493-6e7ae5f3081c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.850452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1710c9-5710-45a6-b493-6e7ae5f3081c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6b1710c9-5710-45a6-b493-6e7ae5f3081c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:55.857452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:55.858420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:35:55.859241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 78/161] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:55.859916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1710c9-5710-45a6-b493-6e7ae5f3081c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:55.880048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81e5d-7d7c-45a3-86cf-c49ce7833d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:55.881150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81e5d-7d7c-45a3-86cf-c49ce7833d5b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.881568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81e5d-7d7c-45a3-86cf-c49ce7833d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.881994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81e5d-7d7c-45a3-86cf-c49ce7833d5b None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.886745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad81e5d-7d7c-45a3-86cf-c49ce7833d5b None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:55.888528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad81e5d-7d7c-45a3-86cf-c49ce7833d5b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:55.890399 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 84/162] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:55 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:55.892331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52f5f9-be41-4095-8312-d0635aadde23 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:55.893297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52f5f9-be41-4095-8312-d0635aadde23 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:55.893297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52f5f9-be41-4095-8312-d0635aadde23 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:55.894392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 85/163] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:55.896842 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52f5f9-be41-4095-8312-d0635aadde23 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:55.898506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:55.990308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:55.993181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1710c9-5710-45a6-b493-6e7ae5f3081c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:56.039820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52f5f9-be41-4095-8312-d0635aadde23 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:56.042198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3ab3-f4e4-4b1b-8bba-183142c0e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:56.042747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3ab3-f4e4-4b1b-8bba-183142c0e036 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:56.043056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3ab3-f4e4-4b1b-8bba-183142c0e036 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:56.043324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3ab3-f4e4-4b1b-8bba-183142c0e036 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:56.045090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3ab3-f4e4-4b1b-8bba-183142c0e036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:56.045398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3ab3-f4e4-4b1b-8bba-183142c0e036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:56.046835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3ab3-f4e4-4b1b-8bba-183142c0e036 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:56.062814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 79/164] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:56.062814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c3560-6e96-40f7-8d73-6fbc67035adb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:56.062814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c3560-6e96-40f7-8d73-6fbc67035adb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:56.062814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c3560-6e96-40f7-8d73-6fbc67035adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:56.082179 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-571c3560-6e96-40f7-8d73-6fbc67035adb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:56.083723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-571c3560-6e96-40f7-8d73-6fbc67035adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:56.099651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26fae-0f3e-4642-adab-2e92f1e7de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:56.100675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26fae-0f3e-4642-adab-2e92f1e7de76 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:56.101130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26fae-0f3e-4642-adab-2e92f1e7de76 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:56.101571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26fae-0f3e-4642-adab-2e92f1e7de76 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:56.102482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd26fae-0f3e-4642-adab-2e92f1e7de76 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:56.103003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd26fae-0f3e-4642-adab-2e92f1e7de76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:56.106069 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd26fae-0f3e-4642-adab-2e92f1e7de76 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:56.125140 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 86/165] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:35:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:56.132370 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26fae-0f3e-4642-adab-2e92f1e7de76 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:56.223061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 80/166] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:56.223997 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c3560-6e96-40f7-8d73-6fbc67035adb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:56.280778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:56.305524 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26fae-0f3e-4642-adab-2e92f1e7de76 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:56.333925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:56.346099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c017e0-8869-4a21-8574-caa77e501063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:56.347602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c017e0-8869-4a21-8574-caa77e501063 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:56.347877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c017e0-8869-4a21-8574-caa77e501063 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:56.348147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c017e0-8869-4a21-8574-caa77e501063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:56.348948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c017e0-8869-4a21-8574-caa77e501063 None admin] RBAC: Adding query filter params (role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=bfc55faa34394f559d12491d3fb33989, user.id=b8d6cc1775b14b0db17609fec02d67a9) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:56.349252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c017e0-8869-4a21-8574-caa77e501063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:56.350942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c017e0-8869-4a21-8574-caa77e501063 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:56.357185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 87/167] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:56 2022] GET /identity/v3/role_assignments?user.id=b8d6cc1775b14b0db17609fec02d67a9&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:56.362549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c017e0-8869-4a21-8574-caa77e501063 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:56.514710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c3560-6e96-40f7-8d73-6fbc67035adb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:56.585789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c017e0-8869-4a21-8574-caa77e501063 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:56.586344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1cbe3-5a68-473a-af27-911e73c2a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:56.586919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1cbe3-5a68-473a-af27-911e73c2a11f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:56.587187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1cbe3-5a68-473a-af27-911e73c2a11f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:56.587468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1cbe3-5a68-473a-af27-911e73c2a11f None admin] PATH_INFO: `/v3/users/0d288edc5a024ebe8b9e0a02e9598b35` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:56.591743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1cbe3-5a68-473a-af27-911e73c2a11f None admin] RBAC: Authorizing `identity:get_user(user_id=0d288edc5a024ebe8b9e0a02e9598b35)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:56.593233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1cbe3-5a68-473a-af27-911e73c2a11f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:56.595346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 81/168] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:56 2022] GET /identity/v3/users/0d288edc5a024ebe8b9e0a02e9598b35 => generated 247 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:56.596163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1cbe3-5a68-473a-af27-911e73c2a11f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:56.663208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbeea0-ae97-4998-bfef-668262cf7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:56.664361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbeea0-ae97-4998-bfef-668262cf7976 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:56.666945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbeea0-ae97-4998-bfef-668262cf7976 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:56.667452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbeea0-ae97-4998-bfef-668262cf7976 None admin] PATH_INFO: `/v3/users/b8d6cc1775b14b0db17609fec02d67a9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:56.669629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbeea0-ae97-4998-bfef-668262cf7976 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d6cc1775b14b0db17609fec02d67a9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:56.673049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbeea0-ae97-4998-bfef-668262cf7976 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:56.675484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 88/169] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:56 2022] GET /identity/v3/users/b8d6cc1775b14b0db17609fec02d67a9 => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:56.680028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbeea0-ae97-4998-bfef-668262cf7976 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:56.771578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:56.795271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:56.801182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1cbe3-5a68-473a-af27-911e73c2a11f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:56.847383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd587d17-e205-4f5b-b9ba-914f84121ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:56.847957 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd587d17-e205-4f5b-b9ba-914f84121ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:56.848237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd587d17-e205-4f5b-b9ba-914f84121ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:56.848517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd587d17-e205-4f5b-b9ba-914f84121ea7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:56.863658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd587d17-e205-4f5b-b9ba-914f84121ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-cd587d17-e205-4f5b-b9ba-914f84121ea7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:56.869529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:56.870395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:35:56.871190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 82/170] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:56.872640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd587d17-e205-4f5b-b9ba-914f84121ea7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:56.878458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbeea0-ae97-4998-bfef-668262cf7976 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:56.995596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddae1c-7c35-43aa-aa7e-0c6e211f639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:56.996227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddae1c-7c35-43aa-aa7e-0c6e211f639c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:56.996509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddae1c-7c35-43aa-aa7e-0c6e211f639c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:56.996781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddae1c-7c35-43aa-aa7e-0c6e211f639c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:57.004660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd587d17-e205-4f5b-b9ba-914f84121ea7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:57.054273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38480a9-2b8a-4114-bf60-c4e9ff8ee2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:57.054984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38480a9-2b8a-4114-bf60-c4e9ff8ee2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:57.055270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38480a9-2b8a-4114-bf60-c4e9ff8ee2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:57.055619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38480a9-2b8a-4114-bf60-c4e9ff8ee2c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:57.076724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:57.166574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddae1c-7c35-43aa-aa7e-0c6e211f639c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:57.168003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddae1c-7c35-43aa-aa7e-0c6e211f639c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:57.170811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38480a9-2b8a-4114-bf60-c4e9ff8ee2c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:57.172441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38480a9-2b8a-4114-bf60-c4e9ff8ee2c8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:57.288061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:57.367004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 89/171] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:57.367885 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddae1c-7c35-43aa-aa7e-0c6e211f639c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:57.391448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 83/172] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:57.392931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38480a9-2b8a-4114-bf60-c4e9ff8ee2c8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:57.491250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:57.545808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38480a9-2b8a-4114-bf60-c4e9ff8ee2c8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:57.581854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddae1c-7c35-43aa-aa7e-0c6e211f639c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:57.585088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66f2c4-d2eb-42fb-856c-e16b1ffb6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:57.585799 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66f2c4-d2eb-42fb-856c-e16b1ffb6202 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:57.586139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66f2c4-d2eb-42fb-856c-e16b1ffb6202 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:57.586468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66f2c4-d2eb-42fb-856c-e16b1ffb6202 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:57.587789 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66f2c4-d2eb-42fb-856c-e16b1ffb6202 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:57.589340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66f2c4-d2eb-42fb-856c-e16b1ffb6202 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:57.595469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 84/173] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:57 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:57.596652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66f2c4-d2eb-42fb-856c-e16b1ffb6202 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:57.653086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dab3df-f74e-40e2-b05b-e5cad63791ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:57.653762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dab3df-f74e-40e2-b05b-e5cad63791ec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:57.653974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dab3df-f74e-40e2-b05b-e5cad63791ec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:57.654245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dab3df-f74e-40e2-b05b-e5cad63791ec None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:57.655060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dab3df-f74e-40e2-b05b-e5cad63791ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:57.655359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dab3df-f74e-40e2-b05b-e5cad63791ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:57.658190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dab3df-f74e-40e2-b05b-e5cad63791ec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:57.679569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 90/174] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:35:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:57.680370 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dab3df-f74e-40e2-b05b-e5cad63791ec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:57.734208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:57.765971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66f2c4-d2eb-42fb-856c-e16b1ffb6202 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:57.780315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:57.802713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61e71c-801c-4185-946f-e2b3f5103408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:57.803489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e71c-801c-4185-946f-e2b3f5103408 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:57.803833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e71c-801c-4185-946f-e2b3f5103408 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:57.804170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e71c-801c-4185-946f-e2b3f5103408 None admin] PATH_INFO: `/v3/projects/9523f199c8c742e7830fb7fafcd1861e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:57.805500 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61e71c-801c-4185-946f-e2b3f5103408 None admin] RBAC: Authorizing `identity:get_project(project_id=9523f199c8c742e7830fb7fafcd1861e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:57.807091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61e71c-801c-4185-946f-e2b3f5103408 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:57.808837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 85/175] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:57 2022] GET /identity/v3/projects/9523f199c8c742e7830fb7fafcd1861e => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:57.815064 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61e71c-801c-4185-946f-e2b3f5103408 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:57.856329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dab3df-f74e-40e2-b05b-e5cad63791ec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:57.893782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cc60f-0907-488b-9d91-091124c970bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:57.894416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cc60f-0907-488b-9d91-091124c970bc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:57.894694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cc60f-0907-488b-9d91-091124c970bc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:57.894997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cc60f-0907-488b-9d91-091124c970bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:57.895801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cc60f-0907-488b-9d91-091124c970bc None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=bfc55faa34394f559d12491d3fb33989, user.id=0d288edc5a024ebe8b9e0a02e9598b35) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:57.896110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cc60f-0907-488b-9d91-091124c970bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:57.897684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cc60f-0907-488b-9d91-091124c970bc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:57.904564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 91/176] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:57 2022] GET /identity/v3/role_assignments?user.id=0d288edc5a024ebe8b9e0a02e9598b35&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=2ba3b2926541436a9d26782420538af3 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:57.905779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813561-33a9-4bcf-9e5e-739ed0a11e8c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:57.906062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813561-33a9-4bcf-9e5e-739ed0a11e8c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:57.906334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813561-33a9-4bcf-9e5e-739ed0a11e8c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:57.912363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 92/177] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:57.913362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813561-33a9-4bcf-9e5e-739ed0a11e8c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:57.943313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61e71c-801c-4185-946f-e2b3f5103408 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:58.005255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea118472-bef2-4213-9003-6c1a928a979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:58.005887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118472-bef2-4213-9003-6c1a928a979b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.006251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118472-bef2-4213-9003-6c1a928a979b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.006527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118472-bef2-4213-9003-6c1a928a979b None admin] PATH_INFO: `/v3/users/d9e7dc500be34136abb21c481f2ecc4f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.008330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea118472-bef2-4213-9003-6c1a928a979b None admin] RBAC: Authorizing `identity:get_user(user_id=d9e7dc500be34136abb21c481f2ecc4f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:58.009835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea118472-bef2-4213-9003-6c1a928a979b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:58.011682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 86/178] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:57 2022] GET /identity/v3/users/d9e7dc500be34136abb21c481f2ecc4f => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:58.011813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:58.014223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361dd40-70d5-423c-8916-00cdb8a7e971 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.014499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361dd40-70d5-423c-8916-00cdb8a7e971 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.017991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361dd40-70d5-423c-8916-00cdb8a7e971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.031888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813561-33a9-4bcf-9e5e-739ed0a11e8c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:58.047367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e361dd40-70d5-423c-8916-00cdb8a7e971 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:58.049465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e361dd40-70d5-423c-8916-00cdb8a7e971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:58.072902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff1e13-7f41-45c6-a4c3-841d309dcc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:58.073541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff1e13-7f41-45c6-a4c3-841d309dcc2c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.073823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff1e13-7f41-45c6-a4c3-841d309dcc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.074096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff1e13-7f41-45c6-a4c3-841d309dcc2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.074957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff1e13-7f41-45c6-a4c3-841d309dcc2c None admin] RBAC: Adding query filter params (role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=9523f199c8c742e7830fb7fafcd1861e, user.id=b8d6cc1775b14b0db17609fec02d67a9) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:58.075274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff1e13-7f41-45c6-a4c3-841d309dcc2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:58.076820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff1e13-7f41-45c6-a4c3-841d309dcc2c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:58.084806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 93/179] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:57 2022] GET /identity/v3/role_assignments?user.id=b8d6cc1775b14b0db17609fec02d67a9&scope.project.id=9523f199c8c742e7830fb7fafcd1861e&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:58.085700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff1e13-7f41-45c6-a4c3-841d309dcc2c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:58.123310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:58.142636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 87/180] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:58.144354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da38b1-33c5-42e3-8908-04c6eadabb91 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.144734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da38b1-33c5-42e3-8908-04c6eadabb91 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.144990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da38b1-33c5-42e3-8908-04c6eadabb91 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.146554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 88/181] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:58.153337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6b7a-d7f6-478d-bd82-fc002985b98e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.153668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6b7a-d7f6-478d-bd82-fc002985b98e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.153953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6b7a-d7f6-478d-bd82-fc002985b98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.174162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-380e6b7a-d7f6-478d-bd82-fc002985b98e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:58.175446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-380e6b7a-d7f6-478d-bd82-fc002985b98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:58.208090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff1e13-7f41-45c6-a4c3-841d309dcc2c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:58.256749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb868eb-f731-4aae-8787-d7cc7bcd2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:58.257457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb868eb-f731-4aae-8787-d7cc7bcd2244 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.257748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb868eb-f731-4aae-8787-d7cc7bcd2244 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.258026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb868eb-f731-4aae-8787-d7cc7bcd2244 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.259422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb868eb-f731-4aae-8787-d7cc7bcd2244 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:58.261017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb868eb-f731-4aae-8787-d7cc7bcd2244 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:58.263080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 94/182] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:58 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:58.263960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb868eb-f731-4aae-8787-d7cc7bcd2244 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:58.275923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 89/183] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:58.277085 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6b7a-d7f6-478d-bd82-fc002985b98e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:58.307709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:58.390316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb868eb-f731-4aae-8787-d7cc7bcd2244 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:58.430064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cea31-78eb-4d69-a0e5-e218f2625be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:58.430708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cea31-78eb-4d69-a0e5-e218f2625be7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.431018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cea31-78eb-4d69-a0e5-e218f2625be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.431292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cea31-78eb-4d69-a0e5-e218f2625be7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.436100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6b7a-d7f6-478d-bd82-fc002985b98e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:58.442706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cea31-78eb-4d69-a0e5-e218f2625be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:58.445684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-395cea31-78eb-4d69-a0e5-e218f2625be7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:58.448320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:58.449216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:58.450000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 95/184] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:58.450651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cea31-78eb-4d69-a0e5-e218f2625be7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:58.476240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a1552-9de2-4216-b441-eddef04c67ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:58.476906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a1552-9de2-4216-b441-eddef04c67ad None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.477181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a1552-9de2-4216-b441-eddef04c67ad None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.477447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a1552-9de2-4216-b441-eddef04c67ad None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989/users/d9e7dc500be34136abb21c481f2ecc4f/roles/a7b8a3f8aa3a461782f12e263408b403` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.479437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a1552-9de2-4216-b441-eddef04c67ad None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc55faa34394f559d12491d3fb33989, user_id=d9e7dc500be34136abb21c481f2ecc4f, role_id=a7b8a3f8aa3a461782f12e263408b403)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:58.480867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a1552-9de2-4216-b441-eddef04c67ad None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:58.493685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 90/185] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:35:58 2022] PUT /identity/v3/projects/bfc55faa34394f559d12491d3fb33989/users/d9e7dc500be34136abb21c481f2ecc4f/roles/a7b8a3f8aa3a461782f12e263408b403 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:35:58.496197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cc54f-53ca-4aa4-8053-6d10aae4c6c6 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.496481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cc54f-53ca-4aa4-8053-6d10aae4c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.496866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cc54f-53ca-4aa4-8053-6d10aae4c6c6 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.498369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 91/186] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:35:58.499777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cc54f-53ca-4aa4-8053-6d10aae4c6c6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:58.535165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:58.564984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cea31-78eb-4d69-a0e5-e218f2625be7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:58.602214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a76a9d-8d46-447d-965a-1fcecdbf90ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:58.602878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a76a9d-8d46-447d-965a-1fcecdbf90ef None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.603190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a76a9d-8d46-447d-965a-1fcecdbf90ef None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.603467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a76a9d-8d46-447d-965a-1fcecdbf90ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.615955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a76a9d-8d46-447d-965a-1fcecdbf90ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:35:58.619100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cc54f-53ca-4aa4-8053-6d10aae4c6c6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e6a76a9d-8d46-447d-965a-1fcecdbf90ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:35:58.621675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:35:58.622839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:35:58.623672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 96/187] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:35:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:35:58.624920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f92e3c-3de8-4bd3-9b21-3d0093a1bd61 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.625200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f92e3c-3de8-4bd3-9b21-3d0093a1bd61 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.625659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f92e3c-3de8-4bd3-9b21-3d0093a1bd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.647514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a9f92e3c-3de8-4bd3-9b21-3d0093a1bd61 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:35:58.649058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a9f92e3c-3de8-4bd3-9b21-3d0093a1bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:35:58.667248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c226d31-0cec-4b20-9869-b503ef8dfd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:58.667870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c226d31-0cec-4b20-9869-b503ef8dfd3a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.668143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c226d31-0cec-4b20-9869-b503ef8dfd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.668407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c226d31-0cec-4b20-9869-b503ef8dfd3a None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.669137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c226d31-0cec-4b20-9869-b503ef8dfd3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:58.669435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c226d31-0cec-4b20-9869-b503ef8dfd3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:58.670808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c226d31-0cec-4b20-9869-b503ef8dfd3a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:58.681868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 92/188] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:58.686981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c226d31-0cec-4b20-9869-b503ef8dfd3a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:58.723787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:58.727024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 97/189] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:35:58.728908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f92e3c-3de8-4bd3-9b21-3d0093a1bd61 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:58.800309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:58.810580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c226d31-0cec-4b20-9869-b503ef8dfd3a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:58.838115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f92e3c-3de8-4bd3-9b21-3d0093a1bd61 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:58.847243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1ac78-ef58-44d5-b850-f258b186d7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:58.847877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1ac78-ef58-44d5-b850-f258b186d7ca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.848164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1ac78-ef58-44d5-b850-f258b186d7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.848435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1ac78-ef58-44d5-b850-f258b186d7ca None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.849180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1ac78-ef58-44d5-b850-f258b186d7ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:35:58.849486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1ac78-ef58-44d5-b850-f258b186d7ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:58.850868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1ac78-ef58-44d5-b850-f258b186d7ca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:58.859671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 93/190] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:35:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:58.864672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1ac78-ef58-44d5-b850-f258b186d7ca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:58.880269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb96fe-183a-4011-8bd7-4ca140a8c781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:58.880934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb96fe-183a-4011-8bd7-4ca140a8c781 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:58.881204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb96fe-183a-4011-8bd7-4ca140a8c781 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:58.881480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb96fe-183a-4011-8bd7-4ca140a8c781 None admin] PATH_INFO: `/v3/users/06793cdd0a194596b841d10319537642` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:58.896540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb96fe-183a-4011-8bd7-4ca140a8c781 None admin] RBAC: Authorizing `identity:get_user(user_id=06793cdd0a194596b841d10319537642)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:58.898027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb96fe-183a-4011-8bd7-4ca140a8c781 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:58.899996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 98/191] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:58 2022] GET /identity/v3/users/06793cdd0a194596b841d10319537642 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:58.900742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb96fe-183a-4011-8bd7-4ca140a8c781 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:58.964693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:58.975391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1ac78-ef58-44d5-b850-f258b186d7ca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:59.008997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb96fe-183a-4011-8bd7-4ca140a8c781 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:59.009936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0089-093a-4e13-83f5-cf3bc31128e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:59.010601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0089-093a-4e13-83f5-cf3bc31128e0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:59.010867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0089-093a-4e13-83f5-cf3bc31128e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:59.011160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0089-093a-4e13-83f5-cf3bc31128e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:59.012341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf0089-093a-4e13-83f5-cf3bc31128e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:59.013796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf0089-093a-4e13-83f5-cf3bc31128e0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:59.015431 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 94/192] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:35:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:59.020133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0089-093a-4e13-83f5-cf3bc31128e0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:59.034603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:59.047282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9815ba-930f-4aec-ba7e-d9267fa124b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:59.048478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9815ba-930f-4aec-ba7e-d9267fa124b1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:59.048764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9815ba-930f-4aec-ba7e-d9267fa124b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:59.049042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9815ba-930f-4aec-ba7e-d9267fa124b1 None admin] PATH_INFO: `/v3/users/06793cdd0a194596b841d10319537642` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:59.050445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9815ba-930f-4aec-ba7e-d9267fa124b1 None admin] RBAC: Authorizing `identity:get_user(user_id=06793cdd0a194596b841d10319537642)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:59.051873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9815ba-930f-4aec-ba7e-d9267fa124b1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:59.057978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 99/193] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:35:58 2022] GET /identity/v3/users/06793cdd0a194596b841d10319537642 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:59.057978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9815ba-930f-4aec-ba7e-d9267fa124b1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:59.148074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0089-093a-4e13-83f5-cf3bc31128e0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:59.164833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9815ba-930f-4aec-ba7e-d9267fa124b1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:59.184395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed976ff-dbd1-4623-95c5-9b2f1eab9ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:59.185308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed976ff-dbd1-4623-95c5-9b2f1eab9ece None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:59.185764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed976ff-dbd1-4623-95c5-9b2f1eab9ece None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:59.186240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed976ff-dbd1-4623-95c5-9b2f1eab9ece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:59.203863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278741b6-0b83-4ba4-b8af-25fd7dd0a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:59.205066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278741b6-0b83-4ba4-b8af-25fd7dd0a35c None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:59.205345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278741b6-0b83-4ba4-b8af-25fd7dd0a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:59.205618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278741b6-0b83-4ba4-b8af-25fd7dd0a35c None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:59.206639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278741b6-0b83-4ba4-b8af-25fd7dd0a35c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:59.208191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278741b6-0b83-4ba4-b8af-25fd7dd0a35c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:59.225165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:59.231811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 100/194] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:35:59 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:35:59.231811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278741b6-0b83-4ba4-b8af-25fd7dd0a35c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:59.292588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:59.310774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed976ff-dbd1-4623-95c5-9b2f1eab9ece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:59.312986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed976ff-dbd1-4623-95c5-9b2f1eab9ece None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:59.386477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278741b6-0b83-4ba4-b8af-25fd7dd0a35c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:59.443588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da550d-dbd0-44dd-a82c-544b0a27cc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:59.443588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da550d-dbd0-44dd-a82c-544b0a27cc0e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:59.443880 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da550d-dbd0-44dd-a82c-544b0a27cc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:59.444040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da550d-dbd0-44dd-a82c-544b0a27cc0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:59.503104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 95/195] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:59.508699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed976ff-dbd1-4623-95c5-9b2f1eab9ece None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:59.547776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da550d-dbd0-44dd-a82c-544b0a27cc0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:59.549987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da550d-dbd0-44dd-a82c-544b0a27cc0e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:59.580989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:59.635762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:35:59.647999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed976ff-dbd1-4623-95c5-9b2f1eab9ece None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:59.714310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 101/196] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:35:59.719676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da550d-dbd0-44dd-a82c-544b0a27cc0e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:59.736252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9296c-40c5-4500-942c-5f9acd9f7303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:59.736920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9296c-40c5-4500-942c-5f9acd9f7303 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:59.737201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9296c-40c5-4500-942c-5f9acd9f7303 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:59.737475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9296c-40c5-4500-942c-5f9acd9f7303 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:59.738791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9296c-40c5-4500-942c-5f9acd9f7303 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:59.740327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9296c-40c5-4500-942c-5f9acd9f7303 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:59.745652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 96/197] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:59 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:59.748283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9296c-40c5-4500-942c-5f9acd9f7303 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:35:59.900366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da550d-dbd0-44dd-a82c-544b0a27cc0e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:59.944970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9296c-40c5-4500-942c-5f9acd9f7303 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:35:59.973504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d10a6b-8c45-441a-8d36-2bd8e46fb9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:35:59.974527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d10a6b-8c45-441a-8d36-2bd8e46fb9ab None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:35:59.975032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d10a6b-8c45-441a-8d36-2bd8e46fb9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:35:59.975507 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d10a6b-8c45-441a-8d36-2bd8e46fb9ab None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:35:59.980547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d10a6b-8c45-441a-8d36-2bd8e46fb9ab None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:35:59.983730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d10a6b-8c45-441a-8d36-2bd8e46fb9ab None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:35:59.989831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 102/198] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:35:59 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:35:59.995774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d10a6b-8c45-441a-8d36-2bd8e46fb9ab None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:00.006734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:00.021222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf10fc-5863-4de6-a854-f15fa7e1ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:00.022140 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf10fc-5863-4de6-a854-f15fa7e1ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:00.023541 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf10fc-5863-4de6-a854-f15fa7e1ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:00.023954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf10fc-5863-4de6-a854-f15fa7e1ffe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:00.025101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf10fc-5863-4de6-a854-f15fa7e1ffe7 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb, user.id=06793cdd0a194596b841d10319537642) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:00.026331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf10fc-5863-4de6-a854-f15fa7e1ffe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:00.028114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf10fc-5863-4de6-a854-f15fa7e1ffe7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:00.029732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:00.043418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 97/199] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:59 2022] GET /identity/v3/role_assignments?user.id=06793cdd0a194596b841d10319537642&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=2ba3b2926541436a9d26782420538af3 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:00.161881 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d10a6b-8c45-441a-8d36-2bd8e46fb9ab None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:00.210390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c375bb-e5ea-4673-83ab-52773f06704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:00.211352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c375bb-e5ea-4673-83ab-52773f06704b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:00.211736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c375bb-e5ea-4673-83ab-52773f06704b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:00.212113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c375bb-e5ea-4673-83ab-52773f06704b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:00.213031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c375bb-e5ea-4673-83ab-52773f06704b None admin] RBAC: Adding query filter params (role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb, user.id=06793cdd0a194596b841d10319537642) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:00.213442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c375bb-e5ea-4673-83ab-52773f06704b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:00.215034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c375bb-e5ea-4673-83ab-52773f06704b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:00.222310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 103/200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:35:59 2022] GET /identity/v3/role_assignments?user.id=06793cdd0a194596b841d10319537642&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:00.766534 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03868-b832-4175-9e93-2666bf53d889 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:00.767608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03868-b832-4175-9e93-2666bf53d889 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:00.768093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03868-b832-4175-9e93-2666bf53d889 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:00.769651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 98/201] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:00.775662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb372-17d6-4a11-87c5-fc44f67dab9f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:00.775958 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb372-17d6-4a11-87c5-fc44f67dab9f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:00.776227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb372-17d6-4a11-87c5-fc44f67dab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:00.803923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-20bbb372-17d6-4a11-87c5-fc44f67dab9f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:00.805136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-20bbb372-17d6-4a11-87c5-fc44f67dab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:00.901222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 104/202] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:00.943146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03868-b832-4175-9e93-2666bf53d889 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:01.070806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03868-b832-4175-9e93-2666bf53d889 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:01.107983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574099a0-2c9b-4101-955c-632cc5020629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:01.108988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574099a0-2c9b-4101-955c-632cc5020629 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:01.109461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574099a0-2c9b-4101-955c-632cc5020629 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:01.109922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574099a0-2c9b-4101-955c-632cc5020629 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:01.121698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574099a0-2c9b-4101-955c-632cc5020629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-574099a0-2c9b-4101-955c-632cc5020629 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:01.128174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:01.129024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:01.129843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:01.132154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 99/203] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:01.138167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb372-17d6-4a11-87c5-fc44f67dab9f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:01.155242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:01.285089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb372-17d6-4a11-87c5-fc44f67dab9f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:01.343719 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7679e9-c588-48a1-a867-900d7e0f264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:01.344277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7679e9-c588-48a1-a867-900d7e0f264c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:01.344567 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7679e9-c588-48a1-a867-900d7e0f264c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:01.345369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7679e9-c588-48a1-a867-900d7e0f264c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:01.346112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7679e9-c588-48a1-a867-900d7e0f264c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:01.346683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7679e9-c588-48a1-a867-900d7e0f264c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:01.348117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7679e9-c588-48a1-a867-900d7e0f264c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:01.363304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 105/204] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:01.363737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574099a0-2c9b-4101-955c-632cc5020629 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:01.459803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:01.525215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574099a0-2c9b-4101-955c-632cc5020629 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:01.558847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c4b83-bd20-47fc-b9d5-2f36751a5ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:01.559517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c4b83-bd20-47fc-b9d5-2f36751a5ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:01.559793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c4b83-bd20-47fc-b9d5-2f36751a5ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:01.560062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c4b83-bd20-47fc-b9d5-2f36751a5ca0 None admin] PATH_INFO: `/v3/users/d9e7dc500be34136abb21c481f2ecc4f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:01.561245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c4b83-bd20-47fc-b9d5-2f36751a5ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=d9e7dc500be34136abb21c481f2ecc4f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:01.562731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c4b83-bd20-47fc-b9d5-2f36751a5ca0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:01.565233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 100/205] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:01 2022] GET /identity/v3/users/d9e7dc500be34136abb21c481f2ecc4f => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:01.570869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7679e9-c588-48a1-a867-900d7e0f264c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:01.697528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:01.733797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7679e9-c588-48a1-a867-900d7e0f264c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:01.782045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2a253-663d-43fa-8171-b2ee6ae161b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:01.782921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2a253-663d-43fa-8171-b2ee6ae161b8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:01.783112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2a253-663d-43fa-8171-b2ee6ae161b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:01.783397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2a253-663d-43fa-8171-b2ee6ae161b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:01.874548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2a253-663d-43fa-8171-b2ee6ae161b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:01.876663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2a253-663d-43fa-8171-b2ee6ae161b8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:01.980817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:02.023442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 106/206] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:02.029550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c4b83-bd20-47fc-b9d5-2f36751a5ca0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:02.067729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a044-3029-4211-9f75-c65f91ebf25e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.068337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a044-3029-4211-9f75-c65f91ebf25e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.068826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a044-3029-4211-9f75-c65f91ebf25e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.070395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 107/207] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:02.084399 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cc6cd-3899-41e6-868f-c84572bc9081 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.085109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cc6cd-3899-41e6-868f-c84572bc9081 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.085630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cc6cd-3899-41e6-868f-c84572bc9081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.124938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2f8cc6cd-3899-41e6-868f-c84572bc9081 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:02.127133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2f8cc6cd-3899-41e6-868f-c84572bc9081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:02.153515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c4b83-bd20-47fc-b9d5-2f36751a5ca0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:02.180021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:02.199758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6274da9-237b-4688-8ce6-7ed0e607b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:02.202257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6274da9-237b-4688-8ce6-7ed0e607b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.203239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6274da9-237b-4688-8ce6-7ed0e607b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.204887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6274da9-237b-4688-8ce6-7ed0e607b9f4 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.207527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6274da9-237b-4688-8ce6-7ed0e607b9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:02.209023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6274da9-237b-4688-8ce6-7ed0e607b9f4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:02.214347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 101/208] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:02 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:02.214347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1875fdc-5904-4c10-a9b3-3105f413a296 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.214347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1875fdc-5904-4c10-a9b3-3105f413a296 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.214347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1875fdc-5904-4c10-a9b3-3105f413a296 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.214347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 102/209] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:02.219345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8229e-c6c0-4474-839b-33f98cd9418e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.220165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8229e-c6c0-4474-839b-33f98cd9418e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.220749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8229e-c6c0-4474-839b-33f98cd9418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.238812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-27f8229e-c6c0-4474-839b-33f98cd9418e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:02.240013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-27f8229e-c6c0-4474-839b-33f98cd9418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:02.253765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 108/210] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 07:36:02.255740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8cc6cd-3899-41e6-868f-c84572bc9081 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:02.310175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 103/211] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:02.315127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8229e-c6c0-4474-839b-33f98cd9418e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:02.384431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8cc6cd-3899-41e6-868f-c84572bc9081 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:02.387130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:02.436959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc6b76-3244-4029-9121-7f106496e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:02.437585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc6b76-3244-4029-9121-7f106496e6ee None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.437865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc6b76-3244-4029-9121-7f106496e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.438139 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc6b76-3244-4029-9121-7f106496e6ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.439803 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc6b76-3244-4029-9121-7f106496e6ee None admin] RBAC: Adding query filter params (role.id=a7b8a3f8aa3a461782f12e263408b403, scope.project.id=bfc55faa34394f559d12491d3fb33989, user.id=d9e7dc500be34136abb21c481f2ecc4f) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:02.440113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc6b76-3244-4029-9121-7f106496e6ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:02.441990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc6b76-3244-4029-9121-7f106496e6ee None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:02.450352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 109/212] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:02 2022] GET /identity/v3/role_assignments?user.id=d9e7dc500be34136abb21c481f2ecc4f&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=a7b8a3f8aa3a461782f12e263408b403 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:02.451686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc6b76-3244-4029-9121-7f106496e6ee None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:02.465236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8229e-c6c0-4474-839b-33f98cd9418e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:02.487544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:02.508940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591d697-e9a7-4974-b742-bccd5cd69827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:02.509542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d697-e9a7-4974-b742-bccd5cd69827 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.509824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d697-e9a7-4974-b742-bccd5cd69827 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.510095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d697-e9a7-4974-b742-bccd5cd69827 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.527377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591d697-e9a7-4974-b742-bccd5cd69827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-3591d697-e9a7-4974-b742-bccd5cd69827 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:02.532638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:02.533605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:02.534369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 104/213] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:02.535831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8adfe4-0bcd-4d58-b6c3-ccf81e504a12 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.535831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8adfe4-0bcd-4d58-b6c3-ccf81e504a12 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.535831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8adfe4-0bcd-4d58-b6c3-ccf81e504a12 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.536952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 105/214] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:02.541976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8adfe4-0bcd-4d58-b6c3-ccf81e504a12 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:02.590611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc6b76-3244-4029-9121-7f106496e6ee None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:02.629776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35df25-5339-485c-a95f-0e80a0309676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:02.630455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35df25-5339-485c-a95f-0e80a0309676 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.630779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35df25-5339-485c-a95f-0e80a0309676 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.631124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35df25-5339-485c-a95f-0e80a0309676 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.633237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35df25-5339-485c-a95f-0e80a0309676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:02.634676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35df25-5339-485c-a95f-0e80a0309676 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:02.636421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 110/215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:02.637564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a491f91-1735-4697-8d0c-71b53921b151 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.643613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a491f91-1735-4697-8d0c-71b53921b151 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.643613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a491f91-1735-4697-8d0c-71b53921b151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.672190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0a491f91-1735-4697-8d0c-71b53921b151 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:02.674992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0a491f91-1735-4697-8d0c-71b53921b151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:02.681177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8adfe4-0bcd-4d58-b6c3-ccf81e504a12 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:02.706612 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:02.727123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46802419-adc5-49fd-8eeb-88706f0130c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:02.728103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46802419-adc5-49fd-8eeb-88706f0130c9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.728584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46802419-adc5-49fd-8eeb-88706f0130c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.729055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46802419-adc5-49fd-8eeb-88706f0130c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.730012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46802419-adc5-49fd-8eeb-88706f0130c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:02.730515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46802419-adc5-49fd-8eeb-88706f0130c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:02.732143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46802419-adc5-49fd-8eeb-88706f0130c9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:02.742971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 106/216] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:02.743926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46802419-adc5-49fd-8eeb-88706f0130c9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:02.755691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 111/217] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:02.756618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a491f91-1735-4697-8d0c-71b53921b151 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:02.806210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:02.865595 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a491f91-1735-4697-8d0c-71b53921b151 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:02.866741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46802419-adc5-49fd-8eeb-88706f0130c9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:02.901829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bc15b-d797-4546-a175-4adac6f04d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:02.902155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8874c5d-b2f0-4907-9433-1bc5a996d1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:02.902500 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bc15b-d797-4546-a175-4adac6f04d58 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.902777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bc15b-d797-4546-a175-4adac6f04d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.902871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8874c5d-b2f0-4907-9433-1bc5a996d1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.903065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bc15b-d797-4546-a175-4adac6f04d58 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.903141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8874c5d-b2f0-4907-9433-1bc5a996d1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.903416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8874c5d-b2f0-4907-9433-1bc5a996d1b7 None admin] PATH_INFO: `/v3/users/a57b8798f1eb4fd387301a1ae60e32bb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.903755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bc15b-d797-4546-a175-4adac6f04d58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:02.905198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bc15b-d797-4546-a175-4adac6f04d58 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:02.918109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8874c5d-b2f0-4907-9433-1bc5a996d1b7 None admin] RBAC: Authorizing `identity:get_user(user_id=a57b8798f1eb4fd387301a1ae60e32bb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:02.920098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8874c5d-b2f0-4907-9433-1bc5a996d1b7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:02.926548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 112/218] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:02 2022] GET /identity/v3/users/a57b8798f1eb4fd387301a1ae60e32bb => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:02.926548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8874c5d-b2f0-4907-9433-1bc5a996d1b7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:02.938916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 107/219] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:36:02 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:36:02.938916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61406b-5bd9-45ba-b49a-3fa32f4b1d2e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:02.938916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61406b-5bd9-45ba-b49a-3fa32f4b1d2e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:02.938916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61406b-5bd9-45ba-b49a-3fa32f4b1d2e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:02.938916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 108/220] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:02.938916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61406b-5bd9-45ba-b49a-3fa32f4b1d2e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:02.958272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:03.048740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8874c5d-b2f0-4907-9433-1bc5a996d1b7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:03.051275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:03.060025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61406b-5bd9-45ba-b49a-3fa32f4b1d2e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:03.091208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4e83f-961e-418e-934d-1da31bd29125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:03.091870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4e83f-961e-418e-934d-1da31bd29125 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.092738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4e83f-961e-418e-934d-1da31bd29125 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.092738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4e83f-961e-418e-934d-1da31bd29125 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.103508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a1f2-8129-42fb-bf4b-9ab681a1f92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:03.104772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a1f2-8129-42fb-bf4b-9ab681a1f92b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.105189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a1f2-8129-42fb-bf4b-9ab681a1f92b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.105594 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a1f2-8129-42fb-bf4b-9ab681a1f92b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.105840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4e83f-961e-418e-934d-1da31bd29125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-33e4e83f-961e-418e-934d-1da31bd29125 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:03.110922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:03.111818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:03.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 113/221] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:36:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:03.116332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb39a2-c37a-42f8-b934-e8b48401cbfc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.116623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb39a2-c37a-42f8-b934-e8b48401cbfc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.116902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb39a2-c37a-42f8-b934-e8b48401cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.141677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5ebb39a2-c37a-42f8-b934-e8b48401cbfc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:03.143418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5ebb39a2-c37a-42f8-b934-e8b48401cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:03.197423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a1f2-8129-42fb-bf4b-9ab681a1f92b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:03.199328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a1f2-8129-42fb-bf4b-9ab681a1f92b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:03.230590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 114/222] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:03.231579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb39a2-c37a-42f8-b934-e8b48401cbfc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:03.251443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:03.327675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:03.334737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 109/223] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:03.335765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a1f2-8129-42fb-bf4b-9ab681a1f92b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:03.357971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb39a2-c37a-42f8-b934-e8b48401cbfc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:03.395039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845365f8-4b4c-47b7-93a0-7f0ed421aaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:03.395836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845365f8-4b4c-47b7-93a0-7f0ed421aaff None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.396212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845365f8-4b4c-47b7-93a0-7f0ed421aaff None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.396576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845365f8-4b4c-47b7-93a0-7f0ed421aaff None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.397402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845365f8-4b4c-47b7-93a0-7f0ed421aaff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:03.397799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845365f8-4b4c-47b7-93a0-7f0ed421aaff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:03.399318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845365f8-4b4c-47b7-93a0-7f0ed421aaff None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:03.409869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 115/224] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:03.410852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845365f8-4b4c-47b7-93a0-7f0ed421aaff None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:03.463604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a1f2-8129-42fb-bf4b-9ab681a1f92b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:03.501094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7481-aaab-486b-8c47-ec4e96e6bdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:03.501940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7481-aaab-486b-8c47-ec4e96e6bdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.502327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7481-aaab-486b-8c47-ec4e96e6bdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.502697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7481-aaab-486b-8c47-ec4e96e6bdf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.515405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:03.517880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf7481-aaab-486b-8c47-ec4e96e6bdf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e6bf7481-aaab-486b-8c47-ec4e96e6bdf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:03.524493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:03.525366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:03.526148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:03.528561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 110/225] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:36:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:03.529741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7481-aaab-486b-8c47-ec4e96e6bdf1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:03.544555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845365f8-4b4c-47b7-93a0-7f0ed421aaff None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:03.583284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667455f-b32f-4d7d-a10e-97ceff0df7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:03.583919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667455f-b32f-4d7d-a10e-97ceff0df7aa None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.584302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667455f-b32f-4d7d-a10e-97ceff0df7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.584583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667455f-b32f-4d7d-a10e-97ceff0df7aa None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.586067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667455f-b32f-4d7d-a10e-97ceff0df7aa None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:03.587589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667455f-b32f-4d7d-a10e-97ceff0df7aa None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:03.589472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 116/226] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:03 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:03.590373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667455f-b32f-4d7d-a10e-97ceff0df7aa None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:03.595738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:03.647861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7481-aaab-486b-8c47-ec4e96e6bdf1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:03.697409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d0ba-5ab6-434a-ada8-63dc411c90d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:03.698066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d0ba-5ab6-434a-ada8-63dc411c90d3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.698344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d0ba-5ab6-434a-ada8-63dc411c90d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.698614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d0ba-5ab6-434a-ada8-63dc411c90d3 None admin] PATH_INFO: `/v3/users/06793cdd0a194596b841d10319537642` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.699889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9d0ba-5ab6-434a-ada8-63dc411c90d3 None admin] RBAC: Authorizing `identity:get_user(user_id=06793cdd0a194596b841d10319537642)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:03.701368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9d0ba-5ab6-434a-ada8-63dc411c90d3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:03.707224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 111/227] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:03 2022] GET /identity/v3/users/06793cdd0a194596b841d10319537642 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:03.707224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d0ba-5ab6-434a-ada8-63dc411c90d3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:03.709964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667455f-b32f-4d7d-a10e-97ceff0df7aa None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:03.747015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e262757-c81e-4b6f-b9f0-e72087282098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:03.747873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e262757-c81e-4b6f-b9f0-e72087282098 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.748336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e262757-c81e-4b6f-b9f0-e72087282098 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.748769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e262757-c81e-4b6f-b9f0-e72087282098 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.749738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e262757-c81e-4b6f-b9f0-e72087282098 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:03.750257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e262757-c81e-4b6f-b9f0-e72087282098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:03.752547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e262757-c81e-4b6f-b9f0-e72087282098 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:03.762137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 117/228] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:03.768474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e262757-c81e-4b6f-b9f0-e72087282098 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:03.773749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:03.839449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d0ba-5ab6-434a-ada8-63dc411c90d3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:03.865011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:03.877820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75411e-4a16-4858-ab03-79ff4e266f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:03.878424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75411e-4a16-4858-ab03-79ff4e266f70 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.878705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75411e-4a16-4858-ab03-79ff4e266f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.879004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75411e-4a16-4858-ab03-79ff4e266f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.879857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75411e-4a16-4858-ab03-79ff4e266f70 None admin] RBAC: Adding query filter params (role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb, user.id=a57b8798f1eb4fd387301a1ae60e32bb) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:03.880170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75411e-4a16-4858-ab03-79ff4e266f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:03.881613 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75411e-4a16-4858-ab03-79ff4e266f70 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:03.884510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e262757-c81e-4b6f-b9f0-e72087282098 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:03.894768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 112/229] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:03 2022] GET /identity/v3/role_assignments?user.id=a57b8798f1eb4fd387301a1ae60e32bb&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:03.894768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75411e-4a16-4858-ab03-79ff4e266f70 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:03.964588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70279b9-6a0b-4116-b9a5-8db07dbc6726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:03.965669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70279b9-6a0b-4116-b9a5-8db07dbc6726 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:03.966148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70279b9-6a0b-4116-b9a5-8db07dbc6726 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:03.966631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70279b9-6a0b-4116-b9a5-8db07dbc6726 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:03.968047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70279b9-6a0b-4116-b9a5-8db07dbc6726 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:03.969767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70279b9-6a0b-4116-b9a5-8db07dbc6726 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:03.972253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 118/230] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:03 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:03.979040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70279b9-6a0b-4116-b9a5-8db07dbc6726 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:04.058676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75411e-4a16-4858-ab03-79ff4e266f70 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:04.113138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00dd43-86b5-49d5-9203-4b7ce2956c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:04.114308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00dd43-86b5-49d5-9203-4b7ce2956c64 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:04.115498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00dd43-86b5-49d5-9203-4b7ce2956c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:04.115981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00dd43-86b5-49d5-9203-4b7ce2956c64 None admin] PATH_INFO: `/v3/users/06793cdd0a194596b841d10319537642` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:04.117684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00dd43-86b5-49d5-9203-4b7ce2956c64 None admin] RBAC: Authorizing `identity:get_user(user_id=06793cdd0a194596b841d10319537642)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:04.120389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:04.121729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00dd43-86b5-49d5-9203-4b7ce2956c64 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:04.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 113/231] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:03 2022] GET /identity/v3/users/06793cdd0a194596b841d10319537642 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:04.132259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00dd43-86b5-49d5-9203-4b7ce2956c64 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:04.159015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70279b9-6a0b-4116-b9a5-8db07dbc6726 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:04.205848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:04.256148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00dd43-86b5-49d5-9203-4b7ce2956c64 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:04.256920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e81ac7-50ea-42f8-af99-286351db2e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:04.258082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e81ac7-50ea-42f8-af99-286351db2e98 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:04.258553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e81ac7-50ea-42f8-af99-286351db2e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:04.259054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e81ac7-50ea-42f8-af99-286351db2e98 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/users/06793cdd0a194596b841d10319537642/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:04.272367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e81ac7-50ea-42f8-af99-286351db2e98 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebaa0703dbbd4070aa41106cffcba1fb, user_id=06793cdd0a194596b841d10319537642, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:04.274972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e81ac7-50ea-42f8-af99-286351db2e98 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:04.296761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490fbca-af31-479a-a8c4-64f59d67069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:04.297870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490fbca-af31-479a-a8c4-64f59d67069e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:04.298376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490fbca-af31-479a-a8c4-64f59d67069e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:04.298913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490fbca-af31-479a-a8c4-64f59d67069e None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:04.300762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490fbca-af31-479a-a8c4-64f59d67069e None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:04.302627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490fbca-af31-479a-a8c4-64f59d67069e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:04.305329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 114/232] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:04 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:04.309429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 119/233] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:36:03 2022] PUT /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/users/06793cdd0a194596b841d10319537642/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:04.320408 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490fbca-af31-479a-a8c4-64f59d67069e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:04.538374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490fbca-af31-479a-a8c4-64f59d67069e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:04.568242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:04.580880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578610b7-0b9b-441d-977c-298f050b612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:04.581556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578610b7-0b9b-441d-977c-298f050b612b None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:04.581835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578610b7-0b9b-441d-977c-298f050b612b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:04.582105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578610b7-0b9b-441d-977c-298f050b612b None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/users/06793cdd0a194596b841d10319537642/roles/d37aa78d5c9d411886137e9cdff24857` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:04.584409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578610b7-0b9b-441d-977c-298f050b612b None admin] RBAC: Authorizing `identity:create_grant(project_id=ebaa0703dbbd4070aa41106cffcba1fb, user_id=06793cdd0a194596b841d10319537642, role_id=d37aa78d5c9d411886137e9cdff24857)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:04.585867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578610b7-0b9b-441d-977c-298f050b612b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:04.602029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 115/234] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:36:04 2022] PUT /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/users/06793cdd0a194596b841d10319537642/roles/d37aa78d5c9d411886137e9cdff24857 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:05.521948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42119b7c-c757-475e-b9a8-52e01ecf57fc None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:05.522936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42119b7c-c757-475e-b9a8-52e01ecf57fc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:05.523413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42119b7c-c757-475e-b9a8-52e01ecf57fc None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:05.524989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 120/235] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:05.530216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a7f13-577c-4a20-8f5b-37f3843dec02 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:05.531106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a7f13-577c-4a20-8f5b-37f3843dec02 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:05.531583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a7f13-577c-4a20-8f5b-37f3843dec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:05.559855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-691a7f13-577c-4a20-8f5b-37f3843dec02 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:05.561414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-691a7f13-577c-4a20-8f5b-37f3843dec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:05.648061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 116/236] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:05.671428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c54d-ab3c-43a2-8e69-e37dff6ce460 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:05.672036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c54d-ab3c-43a2-8e69-e37dff6ce460 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:05.672517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c54d-ab3c-43a2-8e69-e37dff6ce460 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:05.674636 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 121/237] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:05.679816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a7f13-577c-4a20-8f5b-37f3843dec02 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:05.683579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1a7f1-c333-4c59-a199-bb5a4dc9051e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:05.684100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1a7f1-c333-4c59-a199-bb5a4dc9051e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:05.684577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1a7f1-c333-4c59-a199-bb5a4dc9051e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:05.704689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-15c1a7f1-c333-4c59-a199-bb5a4dc9051e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:05.706348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-15c1a7f1-c333-4c59-a199-bb5a4dc9051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:05.787901 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:05.820818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1a7f1-c333-4c59-a199-bb5a4dc9051e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:05.859038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a7f13-577c-4a20-8f5b-37f3843dec02 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:05.888870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:05.924576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:05.928973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c38201-4e15-4630-9ffb-a77d1c6664c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:05.929633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c38201-4e15-4630-9ffb-a77d1c6664c8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:05.929962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c38201-4e15-4630-9ffb-a77d1c6664c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:05.930177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c38201-4e15-4630-9ffb-a77d1c6664c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:05.968496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1a7f1-c333-4c59-a199-bb5a4dc9051e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:05.971733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c38201-4e15-4630-9ffb-a77d1c6664c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-94c38201-4e15-4630-9ffb-a77d1c6664c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:05.976725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:05.977578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:05.978768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 117/239] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:05.987820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c38201-4e15-4630-9ffb-a77d1c6664c8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:06.010818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b1c9-b295-4cc5-8572-e6d32b3f6786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:06.011731 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b1c9-b295-4cc5-8572-e6d32b3f6786 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.012028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b1c9-b295-4cc5-8572-e6d32b3f6786 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.012359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b1c9-b295-4cc5-8572-e6d32b3f6786 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.019657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b1c9-b295-4cc5-8572-e6d32b3f6786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:06.022128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b1c9-b295-4cc5-8572-e6d32b3f6786 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:06.026552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 123/240] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:06.033049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b1c9-b295-4cc5-8572-e6d32b3f6786 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:06.147899 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b1c9-b295-4cc5-8572-e6d32b3f6786 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:06.180823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c38201-4e15-4630-9ffb-a77d1c6664c8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:06.181426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:06.195958 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cce142-617d-4587-9e22-a24bf7311ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:06.196598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cce142-617d-4587-9e22-a24bf7311ff1 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.196881 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cce142-617d-4587-9e22-a24bf7311ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.197159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cce142-617d-4587-9e22-a24bf7311ff1 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.197865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cce142-617d-4587-9e22-a24bf7311ff1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:06.199359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cce142-617d-4587-9e22-a24bf7311ff1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:06.224845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 124/241] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:36:06 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:36:06.292777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d630b8-3119-41da-8d17-592a74eb2fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:06.293440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d630b8-3119-41da-8d17-592a74eb2fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.293718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d630b8-3119-41da-8d17-592a74eb2fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.293994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d630b8-3119-41da-8d17-592a74eb2fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.294769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d630b8-3119-41da-8d17-592a74eb2fc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:06.295101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d630b8-3119-41da-8d17-592a74eb2fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:06.296532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d630b8-3119-41da-8d17-592a74eb2fc5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:06.317643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 118/242] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:06.323103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cce142-617d-4587-9e22-a24bf7311ff1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:06.441648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cce142-617d-4587-9e22-a24bf7311ff1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:06.452489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31782-c793-4fc5-b424-d7137a863cbd None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.452771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31782-c793-4fc5-b424-d7137a863cbd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.453200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31782-c793-4fc5-b424-d7137a863cbd None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.455309 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 119/243] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:06.464355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b533843-c8a6-4d27-b06d-b9e9d72b4e2d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.464863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b533843-c8a6-4d27-b06d-b9e9d72b4e2d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.465278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b533843-c8a6-4d27-b06d-b9e9d72b4e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.482172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e2e68-51c0-4415-a70d-2459f81359fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:06.482832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e2e68-51c0-4415-a70d-2459f81359fc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.483142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e2e68-51c0-4415-a70d-2459f81359fc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.483417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e2e68-51c0-4415-a70d-2459f81359fc None admin] PATH_INFO: `/v3/users/1931d94b8c044a39878d538483b779e9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.492012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3b533843-c8a6-4d27-b06d-b9e9d72b4e2d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:06.493430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3b533843-c8a6-4d27-b06d-b9e9d72b4e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:06.501677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e2e68-51c0-4415-a70d-2459f81359fc None admin] RBAC: Authorizing `identity:get_user(user_id=1931d94b8c044a39878d538483b779e9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:06.503387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e2e68-51c0-4415-a70d-2459f81359fc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:06.505440 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 125/244] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:06 2022] GET /identity/v3/users/1931d94b8c044a39878d538483b779e9 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:06.512510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e2e68-51c0-4415-a70d-2459f81359fc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:06.533649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:06.572851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:06.579835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 120/245] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:06.603618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b533843-c8a6-4d27-b06d-b9e9d72b4e2d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:06.643802 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e2e68-51c0-4415-a70d-2459f81359fc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:06.689181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37130b9e-49eb-4557-9f05-c28e941b80d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:06.690151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37130b9e-49eb-4557-9f05-c28e941b80d3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.690652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37130b9e-49eb-4557-9f05-c28e941b80d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.691161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37130b9e-49eb-4557-9f05-c28e941b80d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.734950 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b533843-c8a6-4d27-b06d-b9e9d72b4e2d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:06.775764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37130b9e-49eb-4557-9f05-c28e941b80d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:06.776407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37130b9e-49eb-4557-9f05-c28e941b80d3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:06.786901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e12153-3fc3-470b-8b65-513049828187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:06.788262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e12153-3fc3-470b-8b65-513049828187 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.788262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e12153-3fc3-470b-8b65-513049828187 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.788262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e12153-3fc3-470b-8b65-513049828187 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.807220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e12153-3fc3-470b-8b65-513049828187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-87e12153-3fc3-470b-8b65-513049828187 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:06.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:06.815444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:06.816297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 121/246] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:06.817517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f422c-f389-4907-899d-deb748f491a9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.819432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f422c-f389-4907-899d-deb748f491a9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.819432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f422c-f389-4907-899d-deb748f491a9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.821800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 122/247] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:06.823468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f422c-f389-4907-899d-deb748f491a9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:06.841947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:06.863164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:06.920840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 126/248] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 07:36:06.922742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037712d-8233-40f9-b305-faea6e2afe0a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:06.923629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037712d-8233-40f9-b305-faea6e2afe0a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:06.923903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037712d-8233-40f9-b305-faea6e2afe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:06.945818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d037712d-8233-40f9-b305-faea6e2afe0a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:06.947262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d037712d-8233-40f9-b305-faea6e2afe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:06.957530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f422c-f389-4907-899d-deb748f491a9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:07.006129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386f245-cbe5-4e7b-adfd-b7889d702b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:07.006953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f245-cbe5-4e7b-adfd-b7889d702b8b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.007325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f245-cbe5-4e7b-adfd-b7889d702b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.007595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f245-cbe5-4e7b-adfd-b7889d702b8b None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.008433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386f245-cbe5-4e7b-adfd-b7889d702b8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:07.009200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386f245-cbe5-4e7b-adfd-b7889d702b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:07.010980 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386f245-cbe5-4e7b-adfd-b7889d702b8b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:07.023759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 123/249] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:07.024736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386f245-cbe5-4e7b-adfd-b7889d702b8b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:07.030550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 127/250] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:07.031453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037712d-8233-40f9-b305-faea6e2afe0a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:07.112783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:07.139827 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037712d-8233-40f9-b305-faea6e2afe0a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:07.140517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:07.155704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386f245-cbe5-4e7b-adfd-b7889d702b8b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:07.176586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30880ec-d4cc-4ebd-84bb-2dd452061ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:07.177242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30880ec-d4cc-4ebd-84bb-2dd452061ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.177522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30880ec-d4cc-4ebd-84bb-2dd452061ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.177799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30880ec-d4cc-4ebd-84bb-2dd452061ef2 None admin] PATH_INFO: `/v3/users/a57b8798f1eb4fd387301a1ae60e32bb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.179034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30880ec-d4cc-4ebd-84bb-2dd452061ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=a57b8798f1eb4fd387301a1ae60e32bb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:07.180514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30880ec-d4cc-4ebd-84bb-2dd452061ef2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:07.182153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 128/251] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:07 2022] GET /identity/v3/users/a57b8798f1eb4fd387301a1ae60e32bb => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:07.182959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30880ec-d4cc-4ebd-84bb-2dd452061ef2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:07.214998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494ede-a6e6-4947-8742-de43fc954f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:07.215706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494ede-a6e6-4947-8742-de43fc954f2d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.216013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494ede-a6e6-4947-8742-de43fc954f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.216309 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494ede-a6e6-4947-8742-de43fc954f2d None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.217558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f494ede-a6e6-4947-8742-de43fc954f2d None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:07.219052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f494ede-a6e6-4947-8742-de43fc954f2d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:07.221055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 124/252] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:07 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:07.221967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494ede-a6e6-4947-8742-de43fc954f2d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:07.290363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30880ec-d4cc-4ebd-84bb-2dd452061ef2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:07.327021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d5ff8-bc8b-4bb7-b4e7-a7bba8bf48ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:07.327671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d5ff8-bc8b-4bb7-b4e7-a7bba8bf48ac None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.327954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d5ff8-bc8b-4bb7-b4e7-a7bba8bf48ac None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.328229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d5ff8-bc8b-4bb7-b4e7-a7bba8bf48ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.339857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d5ff8-bc8b-4bb7-b4e7-a7bba8bf48ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7c0d5ff8-bc8b-4bb7-b4e7-a7bba8bf48ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:07.345667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:07.346816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:07.347672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 129/253] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:36:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:07.348888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d5ff8-bc8b-4bb7-b4e7-a7bba8bf48ac None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:07.359146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:07.393866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494ede-a6e6-4947-8742-de43fc954f2d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:07.446491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5eb91-a210-48c9-b613-f9dc8a4004d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:07.447166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5eb91-a210-48c9-b613-f9dc8a4004d3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.447447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5eb91-a210-48c9-b613-f9dc8a4004d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.447725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5eb91-a210-48c9-b613-f9dc8a4004d3 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.449189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5eb91-a210-48c9-b613-f9dc8a4004d3 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:07.450845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5eb91-a210-48c9-b613-f9dc8a4004d3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:07.452899 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 125/254] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:07 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:07.453654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5eb91-a210-48c9-b613-f9dc8a4004d3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:07.459532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d5ff8-bc8b-4bb7-b4e7-a7bba8bf48ac None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:07.483308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:07.501681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec257-7932-4611-b3dc-0e003b0b41fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:07.502437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec257-7932-4611-b3dc-0e003b0b41fd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.502785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec257-7932-4611-b3dc-0e003b0b41fd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.503147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec257-7932-4611-b3dc-0e003b0b41fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.504127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ec257-7932-4611-b3dc-0e003b0b41fd None admin] RBAC: Adding query filter params (role.id=a7b8a3f8aa3a461782f12e263408b403, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb, user.id=1931d94b8c044a39878d538483b779e9) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:07.504506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ec257-7932-4611-b3dc-0e003b0b41fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:07.506177 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ec257-7932-4611-b3dc-0e003b0b41fd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:07.512772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 130/255] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:07 2022] GET /identity/v3/role_assignments?user.id=1931d94b8c044a39878d538483b779e9&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=a7b8a3f8aa3a461782f12e263408b403 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:07.514131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5a0f-d3da-4021-aa21-36ed8b002cc3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.514501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5a0f-d3da-4021-aa21-36ed8b002cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.514855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5a0f-d3da-4021-aa21-36ed8b002cc3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.517172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 131/256] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:07.517832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5a0f-d3da-4021-aa21-36ed8b002cc3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:07.617458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5eb91-a210-48c9-b613-f9dc8a4004d3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:07.659273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3892a73-e57d-4f81-9418-d9fbdc88975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:07.660528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3892a73-e57d-4f81-9418-d9fbdc88975b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.660815 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3892a73-e57d-4f81-9418-d9fbdc88975b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.661090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3892a73-e57d-4f81-9418-d9fbdc88975b None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.661859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3892a73-e57d-4f81-9418-d9fbdc88975b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:07.662169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3892a73-e57d-4f81-9418-d9fbdc88975b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:07.663701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3892a73-e57d-4f81-9418-d9fbdc88975b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:07.681430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 126/257] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:07.682863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5409b38-ae45-44a9-8ebe-2b344fbe2ffc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.683527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5409b38-ae45-44a9-8ebe-2b344fbe2ffc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.683812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5409b38-ae45-44a9-8ebe-2b344fbe2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.700756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:07.726454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c5409b38-ae45-44a9-8ebe-2b344fbe2ffc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:07.728065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c5409b38-ae45-44a9-8ebe-2b344fbe2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:07.765433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5a0f-d3da-4021-aa21-36ed8b002cc3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:07.804533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3f43-61bc-4aaf-8602-690219060737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:07.805211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3f43-61bc-4aaf-8602-690219060737 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:07.805495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3f43-61bc-4aaf-8602-690219060737 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:07.805770 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3f43-61bc-4aaf-8602-690219060737 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/users/a57b8798f1eb4fd387301a1ae60e32bb/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:07.808256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3f43-61bc-4aaf-8602-690219060737 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebaa0703dbbd4070aa41106cffcba1fb, user_id=a57b8798f1eb4fd387301a1ae60e32bb, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:07.809984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3f43-61bc-4aaf-8602-690219060737 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:07.825555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 132/258] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:36:07 2022] PUT /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/users/a57b8798f1eb4fd387301a1ae60e32bb/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:07.826594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3f43-61bc-4aaf-8602-690219060737 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:07.954406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 127/259] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:07.960943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3f43-61bc-4aaf-8602-690219060737 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:07.991494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5409b38-ae45-44a9-8ebe-2b344fbe2ffc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:08.007251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:08.013407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:08.024289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453fecc-fb10-4f86-b0f1-63c01764c216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:08.024952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453fecc-fb10-4f86-b0f1-63c01764c216 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:08.025233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453fecc-fb10-4f86-b0f1-63c01764c216 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:08.025512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453fecc-fb10-4f86-b0f1-63c01764c216 None admin] PATH_INFO: `/v3/users/06793cdd0a194596b841d10319537642` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:08.027811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453fecc-fb10-4f86-b0f1-63c01764c216 None admin] RBAC: Authorizing `identity:get_user(user_id=06793cdd0a194596b841d10319537642)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:08.030239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453fecc-fb10-4f86-b0f1-63c01764c216 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:08.033461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 133/260] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:07 2022] GET /identity/v3/users/06793cdd0a194596b841d10319537642 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:08.039910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453fecc-fb10-4f86-b0f1-63c01764c216 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:08.133862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5409b38-ae45-44a9-8ebe-2b344fbe2ffc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:08.173175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720423d-e0fc-48a1-a04b-f14fa80bde0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:08.173950 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720423d-e0fc-48a1-a04b-f14fa80bde0a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:08.174229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720423d-e0fc-48a1-a04b-f14fa80bde0a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:08.174507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720423d-e0fc-48a1-a04b-f14fa80bde0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:08.187266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720423d-e0fc-48a1-a04b-f14fa80bde0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f720423d-e0fc-48a1-a04b-f14fa80bde0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:08.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:08.194002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:08.194791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:08.199121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 128/261] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:36:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:08.200880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720423d-e0fc-48a1-a04b-f14fa80bde0a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:08.295416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:08.305123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453fecc-fb10-4f86-b0f1-63c01764c216 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:08.324017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720423d-e0fc-48a1-a04b-f14fa80bde0a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:08.363305 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e5e0f-d682-4ddb-bf5f-156b9c38836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:08.363930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e5e0f-d682-4ddb-bf5f-156b9c38836c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:08.364203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e5e0f-d682-4ddb-bf5f-156b9c38836c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:08.364504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e5e0f-d682-4ddb-bf5f-156b9c38836c None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:08.365713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e5e0f-d682-4ddb-bf5f-156b9c38836c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:08.366033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e5e0f-d682-4ddb-bf5f-156b9c38836c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:08.367696 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e5e0f-d682-4ddb-bf5f-156b9c38836c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:08.378867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 129/262] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:08.384427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e5e0f-d682-4ddb-bf5f-156b9c38836c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:08.391689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96a7d7-9c44-4c65-a37c-20331d969a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:08.392650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96a7d7-9c44-4c65-a37c-20331d969a7f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:08.393136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96a7d7-9c44-4c65-a37c-20331d969a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:08.393605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96a7d7-9c44-4c65-a37c-20331d969a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:08.515521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e5e0f-d682-4ddb-bf5f-156b9c38836c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:08.553286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985dbdf-6bbd-43bd-92fc-f6dc2cc507ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:08.554160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985dbdf-6bbd-43bd-92fc-f6dc2cc507ca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:08.554575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985dbdf-6bbd-43bd-92fc-f6dc2cc507ca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:08.555007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985dbdf-6bbd-43bd-92fc-f6dc2cc507ca None admin] PATH_INFO: `/v3/users/06793cdd0a194596b841d10319537642` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:08.556708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985dbdf-6bbd-43bd-92fc-f6dc2cc507ca None admin] RBAC: Authorizing `identity:get_user(user_id=06793cdd0a194596b841d10319537642)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:08.558292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985dbdf-6bbd-43bd-92fc-f6dc2cc507ca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:08.560377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 130/263] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:08 2022] GET /identity/v3/users/06793cdd0a194596b841d10319537642 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:08.566768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985dbdf-6bbd-43bd-92fc-f6dc2cc507ca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:08.578180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:08.583255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:08.607723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96a7d7-9c44-4c65-a37c-20331d969a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:08.609211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96a7d7-9c44-4c65-a37c-20331d969a7f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:08.687946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985dbdf-6bbd-43bd-92fc-f6dc2cc507ca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:08.776099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132f0bc-7ea2-4af9-91cf-2b0344bdc328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:08.776929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f0bc-7ea2-4af9-91cf-2b0344bdc328 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:08.777311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f0bc-7ea2-4af9-91cf-2b0344bdc328 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:08.777683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f0bc-7ea2-4af9-91cf-2b0344bdc328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:08.797268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 134/264] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:08.801213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96a7d7-9c44-4c65-a37c-20331d969a7f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:08.915283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:08.923470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96a7d7-9c44-4c65-a37c-20331d969a7f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:08.963394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38425a-362d-4aa2-a882-648a416f4863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:08.964974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38425a-362d-4aa2-a882-648a416f4863 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:08.965538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38425a-362d-4aa2-a882-648a416f4863 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:08.965950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38425a-362d-4aa2-a882-648a416f4863 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:08.967367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38425a-362d-4aa2-a882-648a416f4863 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:08.969294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38425a-362d-4aa2-a882-648a416f4863 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:08.971969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 135/265] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:08 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:08.972090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132f0bc-7ea2-4af9-91cf-2b0344bdc328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:08.975421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132f0bc-7ea2-4af9-91cf-2b0344bdc328 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:08.978413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38425a-362d-4aa2-a882-648a416f4863 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:08.989054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:09.085053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38425a-362d-4aa2-a882-648a416f4863 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:09.120667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cf93e-0f77-48c7-8a5a-7b201700c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:09.121515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf93e-0f77-48c7-8a5a-7b201700c6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:09.121932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf93e-0f77-48c7-8a5a-7b201700c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:09.122370 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf93e-0f77-48c7-8a5a-7b201700c6e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:09.123319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cf93e-0f77-48c7-8a5a-7b201700c6e3 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb, user.id=06793cdd0a194596b841d10319537642) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:09.123764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cf93e-0f77-48c7-8a5a-7b201700c6e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:09.125326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cf93e-0f77-48c7-8a5a-7b201700c6e3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:09.139032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 136/266] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:08 2022] GET /identity/v3/role_assignments?user.id=06793cdd0a194596b841d10319537642&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=2ba3b2926541436a9d26782420538af3 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:09.177092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 131/267] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:09.183259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cf93e-0f77-48c7-8a5a-7b201700c6e3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:09.223049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:09.314692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cf93e-0f77-48c7-8a5a-7b201700c6e3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:09.352620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0209354-c88c-48bc-a968-e60f3eb3b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:09.353267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0209354-c88c-48bc-a968-e60f3eb3b88d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:09.353545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0209354-c88c-48bc-a968-e60f3eb3b88d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:09.353815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0209354-c88c-48bc-a968-e60f3eb3b88d None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:09.355001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0209354-c88c-48bc-a968-e60f3eb3b88d None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:09.356437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0209354-c88c-48bc-a968-e60f3eb3b88d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:09.358109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 137/268] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:09 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:09.364749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132f0bc-7ea2-4af9-91cf-2b0344bdc328 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:09.480339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132f0bc-7ea2-4af9-91cf-2b0344bdc328 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:09.487253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4db4-6e72-4da4-8842-7d2f3d2cf25d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:09.487855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4db4-6e72-4da4-8842-7d2f3d2cf25d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:09.488338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4db4-6e72-4da4-8842-7d2f3d2cf25d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:09.488956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:09.491651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 138/269] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:09.498351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf3e3c-d0cc-4738-8929-a011a4cc69b2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:09.498925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf3e3c-d0cc-4738-8929-a011a4cc69b2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:09.499426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf3e3c-d0cc-4738-8929-a011a4cc69b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:09.526240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c9cf3e3c-d0cc-4738-8929-a011a4cc69b2 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:09.527781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab9e86-b77e-49d7-ab51-33e7931f1d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:09.527929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c9cf3e3c-d0cc-4738-8929-a011a4cc69b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:09.528755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9e86-b77e-49d7-ab51-33e7931f1d2a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:09.529275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9e86-b77e-49d7-ab51-33e7931f1d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:09.529758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9e86-b77e-49d7-ab51-33e7931f1d2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:09.530753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab9e86-b77e-49d7-ab51-33e7931f1d2a None admin] RBAC: Adding query filter params (role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb, user.id=06793cdd0a194596b841d10319537642) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:09.531286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab9e86-b77e-49d7-ab51-33e7931f1d2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:09.533486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab9e86-b77e-49d7-ab51-33e7931f1d2a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:09.540617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 132/270] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:09 2022] GET /identity/v3/role_assignments?user.id=06793cdd0a194596b841d10319537642&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:09.648136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 139/271] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:09.690378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab9e86-b77e-49d7-ab51-33e7931f1d2a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:09.804774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab9e86-b77e-49d7-ab51-33e7931f1d2a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:09.823016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208382bc-25e3-4a34-a485-1bcede981eff None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:09.823977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208382bc-25e3-4a34-a485-1bcede981eff None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:09.824475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208382bc-25e3-4a34-a485-1bcede981eff None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:09.826102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 140/272] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:09.831532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ec6a-268c-4dbd-9b99-722a719d08a3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:09.832084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ec6a-268c-4dbd-9b99-722a719d08a3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:09.832578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ec6a-268c-4dbd-9b99-722a719d08a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:09.856410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fe62ec6a-268c-4dbd-9b99-722a719d08a3 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:09.858457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe62ec6a-268c-4dbd-9b99-722a719d08a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:09.862806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50611-21f6-4bbe-9fd7-33b0cac2a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:09.863543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50611-21f6-4bbe-9fd7-33b0cac2a603 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:09.864050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50611-21f6-4bbe-9fd7-33b0cac2a603 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:09.865516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50611-21f6-4bbe-9fd7-33b0cac2a603 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:09.866820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab50611-21f6-4bbe-9fd7-33b0cac2a603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:09.868326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab50611-21f6-4bbe-9fd7-33b0cac2a603 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:09.869957 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 133/273] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:09.876004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50611-21f6-4bbe-9fd7-33b0cac2a603 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:09.884417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:09.930666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:09.951601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 141/274] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:09.981798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62ec6a-268c-4dbd-9b99-722a719d08a3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:10.028371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50611-21f6-4bbe-9fd7-33b0cac2a603 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:10.065622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c73ab-9307-431d-b630-a2c8d2015fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:10.066616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c73ab-9307-431d-b630-a2c8d2015fd2 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:10.067133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c73ab-9307-431d-b630-a2c8d2015fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:10.067611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c73ab-9307-431d-b630-a2c8d2015fd2 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:10.068508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c73ab-9307-431d-b630-a2c8d2015fd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:10.070689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c73ab-9307-431d-b630-a2c8d2015fd2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:10.099200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62ec6a-268c-4dbd-9b99-722a719d08a3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:10.100692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 134/275] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:36:09 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:36:10.147542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9f9f-3826-4604-a2a4-062889c5ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:10.148252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9f9f-3826-4604-a2a4-062889c5ae8d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:10.148537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9f9f-3826-4604-a2a4-062889c5ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:10.148812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9f9f-3826-4604-a2a4-062889c5ae8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:10.162842 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b9f9f-3826-4604-a2a4-062889c5ae8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c20b9f9f-3826-4604-a2a4-062889c5ae8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:10.167988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:10.168909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:10.169686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 142/276] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:10.175525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c73ab-9307-431d-b630-a2c8d2015fd2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:10.246960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45615747-6bd5-475e-af1f-dc74f8e8db1c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:10.247267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45615747-6bd5-475e-af1f-dc74f8e8db1c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:10.247541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45615747-6bd5-475e-af1f-dc74f8e8db1c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:10.249942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 143/277] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:10.257553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae375000-9be0-4fa5-aed1-53c99df2c102 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:10.257891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae375000-9be0-4fa5-aed1-53c99df2c102 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:10.258266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae375000-9be0-4fa5-aed1-53c99df2c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:10.284611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ae375000-9be0-4fa5-aed1-53c99df2c102 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:10.285874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ae375000-9be0-4fa5-aed1-53c99df2c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:10.287228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:10.292386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c73ab-9307-431d-b630-a2c8d2015fd2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:10.298155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:10.337896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e1d6c-c7c2-44c9-adb7-d1558b2235d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:10.338677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e1d6c-c7c2-44c9-adb7-d1558b2235d9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:10.339093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e1d6c-c7c2-44c9-adb7-d1558b2235d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:10.339802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e1d6c-c7c2-44c9-adb7-d1558b2235d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:10.341239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e1d6c-c7c2-44c9-adb7-d1558b2235d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:10.342012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e1d6c-c7c2-44c9-adb7-d1558b2235d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:10.343579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e1d6c-c7c2-44c9-adb7-d1558b2235d9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:10.354523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 135/278] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:10.360872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e1d6c-c7c2-44c9-adb7-d1558b2235d9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:10.383566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 144/279] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:10.406829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae375000-9be0-4fa5-aed1-53c99df2c102 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:10.502757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e1d6c-c7c2-44c9-adb7-d1558b2235d9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:10.562301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae375000-9be0-4fa5-aed1-53c99df2c102 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:10.566059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbc64e-8d0b-46a2-872a-c87ec7947e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:10.566733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbc64e-8d0b-46a2-872a-c87ec7947e71 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:10.567063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbc64e-8d0b-46a2-872a-c87ec7947e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:10.567522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbc64e-8d0b-46a2-872a-c87ec7947e71 None admin] PATH_INFO: `/v3/users/50e41ee1bfbc4be38f32f5235ce39aa3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:10.586939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbc64e-8d0b-46a2-872a-c87ec7947e71 None admin] RBAC: Authorizing `identity:get_user(user_id=50e41ee1bfbc4be38f32f5235ce39aa3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:10.589175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbc64e-8d0b-46a2-872a-c87ec7947e71 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:10.592417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 136/280] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:10 2022] GET /identity/v3/users/50e41ee1bfbc4be38f32f5235ce39aa3 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:10.601492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbc64e-8d0b-46a2-872a-c87ec7947e71 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:10.611311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad0e75-5884-428c-a55c-c34899c21c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:10.611980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad0e75-5884-428c-a55c-c34899c21c79 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:10.612264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad0e75-5884-428c-a55c-c34899c21c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:10.612539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad0e75-5884-428c-a55c-c34899c21c79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:10.626812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad0e75-5884-428c-a55c-c34899c21c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:10.629243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c8ad0e75-5884-428c-a55c-c34899c21c79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:10.634870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:10.636061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:10.636860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 145/281] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:10.648198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad0e75-5884-428c-a55c-c34899c21c79 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:10.656881 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:10.808326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbc64e-8d0b-46a2-872a-c87ec7947e71 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:10.843189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad0e75-5884-428c-a55c-c34899c21c79 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:10.871619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5b034-aaa0-41ed-a8ca-c30b71ae304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:10.872354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5b034-aaa0-41ed-a8ca-c30b71ae304e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:10.872734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5b034-aaa0-41ed-a8ca-c30b71ae304e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:10.873159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5b034-aaa0-41ed-a8ca-c30b71ae304e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:10.873954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5b034-aaa0-41ed-a8ca-c30b71ae304e None admin] RBAC: Adding query filter params (role.id=a53dca7201f54f8b841a25178a7e91a6, user.id=50e41ee1bfbc4be38f32f5235ce39aa3, scope.system=all) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:10.874331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5b034-aaa0-41ed-a8ca-c30b71ae304e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:10.876284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5b034-aaa0-41ed-a8ca-c30b71ae304e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:10.887552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a3b3-79ca-41d4-98cd-6514ecf40d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:10.888503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a3b3-79ca-41d4-98cd-6514ecf40d6e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:10.888801 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 137/282] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jul 27 07:36:10 2022] GET /identity/v3/role_assignments?user.id=50e41ee1bfbc4be38f32f5235ce39aa3&scope.system=all&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:10.889219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a3b3-79ca-41d4-98cd-6514ecf40d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:10.889691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a3b3-79ca-41d4-98cd-6514ecf40d6e None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:10.890641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a3b3-79ca-41d4-98cd-6514ecf40d6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:10.891199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a3b3-79ca-41d4-98cd-6514ecf40d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:10.893396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a3b3-79ca-41d4-98cd-6514ecf40d6e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:10.904094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 146/283] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:10.911270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5b034-aaa0-41ed-a8ca-c30b71ae304e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:11.005201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:11.031412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5b034-aaa0-41ed-a8ca-c30b71ae304e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:11.063692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b2b5-c83a-4ca4-8068-ee687ba6e94a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:11.064008 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b2b5-c83a-4ca4-8068-ee687ba6e94a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:11.064240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b2b5-c83a-4ca4-8068-ee687ba6e94a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:11.065934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 147/284] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:11.071549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815b698-e578-46a8-a264-8b11400ca6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:11.071888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a538-83e3-411c-ab90-1720c92dadc9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:11.072174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a538-83e3-411c-ab90-1720c92dadc9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:11.072275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b698-e578-46a8-a264-8b11400ca6bf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:11.072447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a538-83e3-411c-ab90-1720c92dadc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:11.072544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b698-e578-46a8-a264-8b11400ca6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:11.072724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b698-e578-46a8-a264-8b11400ca6bf None admin] PATH_INFO: `/v3/users/1931d94b8c044a39878d538483b779e9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:11.073958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815b698-e578-46a8-a264-8b11400ca6bf None admin] RBAC: Authorizing `identity:get_user(user_id=1931d94b8c044a39878d538483b779e9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:11.075692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815b698-e578-46a8-a264-8b11400ca6bf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:11.077380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 138/285] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:10 2022] GET /identity/v3/users/1931d94b8c044a39878d538483b779e9 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:11.084000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815b698-e578-46a8-a264-8b11400ca6bf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:11.112044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3aa8a538-83e3-411c-ab90-1720c92dadc9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:11.113292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3aa8a538-83e3-411c-ab90-1720c92dadc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:11.198439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815b698-e578-46a8-a264-8b11400ca6bf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:11.207658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:11.217853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 148/286] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:11.237829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de297-df67-4d22-9815-98b90780553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:11.238477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de297-df67-4d22-9815-98b90780553a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:11.238751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de297-df67-4d22-9815-98b90780553a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:11.239049 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de297-df67-4d22-9815-98b90780553a None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:11.240226 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de297-df67-4d22-9815-98b90780553a None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:11.241659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de297-df67-4d22-9815-98b90780553a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:11.243610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a538-83e3-411c-ab90-1720c92dadc9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:11.248651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 139/287] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:11 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:11.249991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de297-df67-4d22-9815-98b90780553a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:11.267076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:11.355346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a538-83e3-411c-ab90-1720c92dadc9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:11.357592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de297-df67-4d22-9815-98b90780553a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:11.394210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-added61f-6f0d-440d-8e0e-d42b697f7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:11.394905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-added61f-6f0d-440d-8e0e-d42b697f7b14 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:11.395187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-added61f-6f0d-440d-8e0e-d42b697f7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:11.395457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-added61f-6f0d-440d-8e0e-d42b697f7b14 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/users/1931d94b8c044a39878d538483b779e9/roles/a7b8a3f8aa3a461782f12e263408b403` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:11.396452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9857-cb98-457c-b995-c6ca17ef8d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:11.397417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-added61f-6f0d-440d-8e0e-d42b697f7b14 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebaa0703dbbd4070aa41106cffcba1fb, user_id=1931d94b8c044a39878d538483b779e9, role_id=a7b8a3f8aa3a461782f12e263408b403)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:11.397528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9857-cb98-457c-b995-c6ca17ef8d2c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:11.397990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9857-cb98-457c-b995-c6ca17ef8d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:11.398471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9857-cb98-457c-b995-c6ca17ef8d2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:11.398842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-added61f-6f0d-440d-8e0e-d42b697f7b14 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:11.411096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9857-cb98-457c-b995-c6ca17ef8d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:11.414315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 140/288] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:36:11 2022] PUT /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/users/1931d94b8c044a39878d538483b779e9/roles/a7b8a3f8aa3a461782f12e263408b403 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-134c9857-cb98-457c-b995-c6ca17ef8d2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:11.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:11.418307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:11.419153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:11.421883 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 149/289] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:11.427976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-added61f-6f0d-440d-8e0e-d42b697f7b14 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:11.552275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:11.586638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-added61f-6f0d-440d-8e0e-d42b697f7b14 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:11.631837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ef439-e1c1-403c-ab1e-25b51627722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:11.632393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ef439-e1c1-403c-ab1e-25b51627722d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:11.632671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ef439-e1c1-403c-ab1e-25b51627722d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:11.632940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ef439-e1c1-403c-ab1e-25b51627722d None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:11.633683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ef439-e1c1-403c-ab1e-25b51627722d None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:11.633980 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ef439-e1c1-403c-ab1e-25b51627722d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:11.635433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ef439-e1c1-403c-ab1e-25b51627722d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:11.645609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 141/290] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:11.651681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9857-cb98-457c-b995-c6ca17ef8d2c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:11.736901 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:11.787892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9857-cb98-457c-b995-c6ca17ef8d2c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:11.837709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaf7f9-63a6-4c8c-8fd6-b1f1128878df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:11.838512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaf7f9-63a6-4c8c-8fd6-b1f1128878df None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:11.838787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaf7f9-63a6-4c8c-8fd6-b1f1128878df None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:11.839110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaf7f9-63a6-4c8c-8fd6-b1f1128878df None admin] PATH_INFO: `/v3/users/a57b8798f1eb4fd387301a1ae60e32bb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:11.843897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaf7f9-63a6-4c8c-8fd6-b1f1128878df None admin] RBAC: Authorizing `identity:get_user(user_id=a57b8798f1eb4fd387301a1ae60e32bb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:11.846046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaf7f9-63a6-4c8c-8fd6-b1f1128878df None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:11.848343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 150/291] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:11 2022] GET /identity/v3/users/a57b8798f1eb4fd387301a1ae60e32bb => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:11.854132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ef439-e1c1-403c-ab1e-25b51627722d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:11.991858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ef439-e1c1-403c-ab1e-25b51627722d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:12.029235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68dabc-6f2f-4c75-be40-f5ed004a927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:12.029883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68dabc-6f2f-4c75-be40-f5ed004a927b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:12.030198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68dabc-6f2f-4c75-be40-f5ed004a927b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:12.030467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68dabc-6f2f-4c75-be40-f5ed004a927b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:12.035223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:12.113610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68dabc-6f2f-4c75-be40-f5ed004a927b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:12.115119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68dabc-6f2f-4c75-be40-f5ed004a927b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:12.226242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 142/292] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:12.227639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaf7f9-63a6-4c8c-8fd6-b1f1128878df None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:12.333590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaf7f9-63a6-4c8c-8fd6-b1f1128878df None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:12.358402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:12.370716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23154fe-f06c-436f-a7d3-d6cb133cfff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:12.371399 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23154fe-f06c-436f-a7d3-d6cb133cfff2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:12.371675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23154fe-f06c-436f-a7d3-d6cb133cfff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:12.371946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23154fe-f06c-436f-a7d3-d6cb133cfff2 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:12.373125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23154fe-f06c-436f-a7d3-d6cb133cfff2 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:12.374564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23154fe-f06c-436f-a7d3-d6cb133cfff2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:12.376339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 151/293] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:12 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:12.382324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68dabc-6f2f-4c75-be40-f5ed004a927b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:12.418536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:12.501749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68dabc-6f2f-4c75-be40-f5ed004a927b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:12.537669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883db5d-9b22-4201-9f19-5d274a3031ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:12.538285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883db5d-9b22-4201-9f19-5d274a3031ce None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:12.538559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883db5d-9b22-4201-9f19-5d274a3031ce None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:12.538824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883db5d-9b22-4201-9f19-5d274a3031ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:12.539669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883db5d-9b22-4201-9f19-5d274a3031ce None admin] RBAC: Adding query filter params (role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb, user.id=a57b8798f1eb4fd387301a1ae60e32bb) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:12.540054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883db5d-9b22-4201-9f19-5d274a3031ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:12.541488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883db5d-9b22-4201-9f19-5d274a3031ce None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:12.555044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 143/294] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:12 2022] GET /identity/v3/role_assignments?user.id=a57b8798f1eb4fd387301a1ae60e32bb&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:12.891967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dd551-30b5-4749-86e5-13987c2391f3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:12.892860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dd551-30b5-4749-86e5-13987c2391f3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:12.892860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dd551-30b5-4749-86e5-13987c2391f3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:12.894983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 152/295] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:12.902025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d123cc5-aecc-4ebd-bbc0-94aadbff0442 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:12.902684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d123cc5-aecc-4ebd-bbc0-94aadbff0442 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:12.902684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d123cc5-aecc-4ebd-bbc0-94aadbff0442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:12.925474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa0d1-1e70-4f8c-90bf-38af6c81cd06 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:12.925828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa0d1-1e70-4f8c-90bf-38af6c81cd06 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:12.926049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa0d1-1e70-4f8c-90bf-38af6c81cd06 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:12.927437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 153/296] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:12.928209 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2d123cc5-aecc-4ebd-bbc0-94aadbff0442 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:12.929739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2d123cc5-aecc-4ebd-bbc0-94aadbff0442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:12.932591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24e50-d0d4-45f1-9644-becf94704c48 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:12.932879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24e50-d0d4-45f1-9644-becf94704c48 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:12.933154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24e50-d0d4-45f1-9644-becf94704c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:12.956550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-03f24e50-d0d4-45f1-9644-becf94704c48 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:12.957789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-03f24e50-d0d4-45f1-9644-becf94704c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:13.052309 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 144/297] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:13.056427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 154/298] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:13.080156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d123cc5-aecc-4ebd-bbc0-94aadbff0442 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:13.088235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24e50-d0d4-45f1-9644-becf94704c48 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:13.120645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:13.213561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24e50-d0d4-45f1-9644-becf94704c48 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:13.216651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d123cc5-aecc-4ebd-bbc0-94aadbff0442 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:13.249508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:13.264817 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b8409-23b4-4b91-81d5-335b17af25d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:13.266044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b8409-23b4-4b91-81d5-335b17af25d0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:13.266608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b8409-23b4-4b91-81d5-335b17af25d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:13.267053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b8409-23b4-4b91-81d5-335b17af25d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:13.267165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172c11-1d9f-4baa-9394-de5267381531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:13.267742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172c11-1d9f-4baa-9394-de5267381531 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:13.268019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172c11-1d9f-4baa-9394-de5267381531 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:13.268305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172c11-1d9f-4baa-9394-de5267381531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:13.269471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09172c11-1d9f-4baa-9394-de5267381531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:13.270970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09172c11-1d9f-4baa-9394-de5267381531 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:13.277696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 155/299] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:13.278626 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172c11-1d9f-4baa-9394-de5267381531 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:13.281343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b8409-23b4-4b91-81d5-335b17af25d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5a4b8409-23b4-4b91-81d5-335b17af25d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:13.288913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:13.290042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:13.290824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:13.292465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 145/300] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:13.300349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b8409-23b4-4b91-81d5-335b17af25d0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:13.403929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172c11-1d9f-4baa-9394-de5267381531 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:13.417759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:13.430305 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b8409-23b4-4b91-81d5-335b17af25d0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:13.451381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8784f-f056-4f0a-940c-04110d31c054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:13.452726 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8784f-f056-4f0a-940c-04110d31c054 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:13.453163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8784f-f056-4f0a-940c-04110d31c054 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:13.453760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8784f-f056-4f0a-940c-04110d31c054 None admin] PATH_INFO: `/v3/groups` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:13.454686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8784f-f056-4f0a-940c-04110d31c054 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:13.456962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8784f-f056-4f0a-940c-04110d31c054 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:13.467339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b298f-a1ed-4f83-82b5-41e088200948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:13.467891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b298f-a1ed-4f83-82b5-41e088200948 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:13.468235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b298f-a1ed-4f83-82b5-41e088200948 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:13.468570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b298f-a1ed-4f83-82b5-41e088200948 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:13.470081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b298f-a1ed-4f83-82b5-41e088200948 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:13.470466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b298f-a1ed-4f83-82b5-41e088200948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:13.472366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b298f-a1ed-4f83-82b5-41e088200948 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:13.479598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 156/301] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Jul 27 07:36:13 2022] POST /identity/v3/groups => generated 229 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:36:13.489425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 146/302] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:13.495545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8784f-f056-4f0a-940c-04110d31c054 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:13.557282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:13.567167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601477af-864a-45f9-a328-7cc78e1d85ce None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:13.567167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601477af-864a-45f9-a328-7cc78e1d85ce None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:13.567497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601477af-864a-45f9-a328-7cc78e1d85ce None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:13.569115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 147/303] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:13.574779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a442ab7-6c36-4da9-af3d-2fd13f99fec4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:13.575097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a442ab7-6c36-4da9-af3d-2fd13f99fec4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:13.575354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a442ab7-6c36-4da9-af3d-2fd13f99fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:13.594970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2a442ab7-6c36-4da9-af3d-2fd13f99fec4 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:13.596275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2a442ab7-6c36-4da9-af3d-2fd13f99fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:13.636024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8784f-f056-4f0a-940c-04110d31c054 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:13.679816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 148/304] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:13.687905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa3444-1333-4a3e-a794-2a658165cd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:13.688571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa3444-1333-4a3e-a794-2a658165cd0f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:13.688794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa3444-1333-4a3e-a794-2a658165cd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:13.689071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa3444-1333-4a3e-a794-2a658165cd0f None admin] PATH_INFO: `/v3/users/a8c2f5dc5fdd41b0aa9d96c06744b9a1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:13.703801 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a442ab7-6c36-4da9-af3d-2fd13f99fec4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:13.706124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa3444-1333-4a3e-a794-2a658165cd0f None admin] RBAC: Authorizing `identity:get_user(user_id=a8c2f5dc5fdd41b0aa9d96c06744b9a1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:13.707896 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa3444-1333-4a3e-a794-2a658165cd0f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:13.710496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 157/305] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:13 2022] GET /identity/v3/users/a8c2f5dc5fdd41b0aa9d96c06744b9a1 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:13.716764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa3444-1333-4a3e-a794-2a658165cd0f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:13.809726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:13.837656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a442ab7-6c36-4da9-af3d-2fd13f99fec4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:13.838129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa3444-1333-4a3e-a794-2a658165cd0f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:13.850508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:13.875716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02da607-73ce-4d8a-a67c-16d0feba8edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:13.876863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02da607-73ce-4d8a-a67c-16d0feba8edc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:13.877136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02da607-73ce-4d8a-a67c-16d0feba8edc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:13.877402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02da607-73ce-4d8a-a67c-16d0feba8edc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:13.881127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178dbca-8f9b-42ee-9a70-ce68666ef75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:13.881928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178dbca-8f9b-42ee-9a70-ce68666ef75d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:13.882449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178dbca-8f9b-42ee-9a70-ce68666ef75d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:13.882868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178dbca-8f9b-42ee-9a70-ce68666ef75d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:13.883802 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178dbca-8f9b-42ee-9a70-ce68666ef75d None admin] RBAC: Adding query filter params (role.id=a7b8a3f8aa3a461782f12e263408b403, user.id=a8c2f5dc5fdd41b0aa9d96c06744b9a1, scope.system=all) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:13.884120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178dbca-8f9b-42ee-9a70-ce68666ef75d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:13.885597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178dbca-8f9b-42ee-9a70-ce68666ef75d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:13.894129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 158/306] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jul 27 07:36:13 2022] GET /identity/v3/role_assignments?user.id=a8c2f5dc5fdd41b0aa9d96c06744b9a1&scope.system=all&role.id=a7b8a3f8aa3a461782f12e263408b403 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:13.899121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02da607-73ce-4d8a-a67c-16d0feba8edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f02da607-73ce-4d8a-a67c-16d0feba8edc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:13.903025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:13.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:13.905187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 149/307] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:13.910640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178dbca-8f9b-42ee-9a70-ce68666ef75d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:14.026156 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178dbca-8f9b-42ee-9a70-ce68666ef75d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:14.032475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0117d7d-20bb-4b2e-b67a-159b9bc3e669 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:14.032800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0117d7d-20bb-4b2e-b67a-159b9bc3e669 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:14.033023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0117d7d-20bb-4b2e-b67a-159b9bc3e669 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:14.038614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 150/308] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:14.040715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6acf46-8d17-434d-8313-f0205e405cf7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:14.041003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6acf46-8d17-434d-8313-f0205e405cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:14.041382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6acf46-8d17-434d-8313-f0205e405cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:14.062104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cf6acf46-8d17-434d-8313-f0205e405cf7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:14.063867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cf6acf46-8d17-434d-8313-f0205e405cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:14.070702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ac766-e137-4af3-aa7e-ffaa52771742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:14.071741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ac766-e137-4af3-aa7e-ffaa52771742 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:14.072225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ac766-e137-4af3-aa7e-ffaa52771742 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:14.072700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ac766-e137-4af3-aa7e-ffaa52771742 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:14.073816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ac766-e137-4af3-aa7e-ffaa52771742 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:14.074132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ac766-e137-4af3-aa7e-ffaa52771742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:14.075576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ac766-e137-4af3-aa7e-ffaa52771742 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:14.086253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 159/309] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:14.091596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ac766-e137-4af3-aa7e-ffaa52771742 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:14.143295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:14.170973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 151/310] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:14.192819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6acf46-8d17-434d-8313-f0205e405cf7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:14.226444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ac766-e137-4af3-aa7e-ffaa52771742 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:14.273269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866773d6-1849-440c-948c-15b970597002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:14.274559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866773d6-1849-440c-948c-15b970597002 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:14.275090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866773d6-1849-440c-948c-15b970597002 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:14.276128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866773d6-1849-440c-948c-15b970597002 None admin] PATH_INFO: `/v3/users/50e41ee1bfbc4be38f32f5235ce39aa3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:14.277935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866773d6-1849-440c-948c-15b970597002 None admin] RBAC: Authorizing `identity:get_user(user_id=50e41ee1bfbc4be38f32f5235ce39aa3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:14.280119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:14.282811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866773d6-1849-440c-948c-15b970597002 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:14.285537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 160/311] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:14 2022] GET /identity/v3/users/50e41ee1bfbc4be38f32f5235ce39aa3 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:14.292725 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866773d6-1849-440c-948c-15b970597002 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:14.316259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6acf46-8d17-434d-8313-f0205e405cf7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:14.354656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b5988-a31f-44bd-9726-20b83395e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:14.355829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b5988-a31f-44bd-9726-20b83395e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:14.356326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b5988-a31f-44bd-9726-20b83395e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:14.356790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b5988-a31f-44bd-9726-20b83395e1b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:14.368839 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b5988-a31f-44bd-9726-20b83395e1b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6f2b5988-a31f-44bd-9726-20b83395e1b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:14.375043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:14.376466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:14.377232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:14.384712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 152/312] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:14.386335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b5988-a31f-44bd-9726-20b83395e1b5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:14.403084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866773d6-1849-440c-948c-15b970597002 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:14.411306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:14.442633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad188fe-3b7d-4cf4-b07a-88d8f433efd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:14.443334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad188fe-3b7d-4cf4-b07a-88d8f433efd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:14.443615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad188fe-3b7d-4cf4-b07a-88d8f433efd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:14.443889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad188fe-3b7d-4cf4-b07a-88d8f433efd8 None admin] PATH_INFO: `/v3/system/users/50e41ee1bfbc4be38f32f5235ce39aa3/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:14.445389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad188fe-3b7d-4cf4-b07a-88d8f433efd8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=50e41ee1bfbc4be38f32f5235ce39aa3, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:14.446971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad188fe-3b7d-4cf4-b07a-88d8f433efd8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:14.463088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 161/313] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Jul 27 07:36:14 2022] PUT /identity/v3/system/users/50e41ee1bfbc4be38f32f5235ce39aa3/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:14.530568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b5988-a31f-44bd-9726-20b83395e1b5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:14.565630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:14.572284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ca5ad-54c4-49b6-afbd-8a0e09dd78b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:14.573199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ca5ad-54c4-49b6-afbd-8a0e09dd78b8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:14.573692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ca5ad-54c4-49b6-afbd-8a0e09dd78b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:14.574174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ca5ad-54c4-49b6-afbd-8a0e09dd78b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:14.575221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ca5ad-54c4-49b6-afbd-8a0e09dd78b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:14.575723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ca5ad-54c4-49b6-afbd-8a0e09dd78b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:14.577498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ca5ad-54c4-49b6-afbd-8a0e09dd78b8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:14.592099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 153/314] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:14.594844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad188fe-3b7d-4cf4-b07a-88d8f433efd8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:14.707665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad188fe-3b7d-4cf4-b07a-88d8f433efd8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:14.743503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9f96e-4557-4226-a580-36982b00c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:14.744149 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f96e-4557-4226-a580-36982b00c035 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:14.744428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f96e-4557-4226-a580-36982b00c035 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:14.744707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f96e-4557-4226-a580-36982b00c035 None admin] PATH_INFO: `/v3/users/1931d94b8c044a39878d538483b779e9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:14.745991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9f96e-4557-4226-a580-36982b00c035 None admin] RBAC: Authorizing `identity:get_user(user_id=1931d94b8c044a39878d538483b779e9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:14.747496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9f96e-4557-4226-a580-36982b00c035 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:14.749315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 162/315] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:14 2022] GET /identity/v3/users/1931d94b8c044a39878d538483b779e9 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:14.754783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ca5ad-54c4-49b6-afbd-8a0e09dd78b8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:14.867440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ca5ad-54c4-49b6-afbd-8a0e09dd78b8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:14.903377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d150434-07ca-42e3-8cbc-206a2982c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:14.904674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d150434-07ca-42e3-8cbc-206a2982c2dc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:14.905099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d150434-07ca-42e3-8cbc-206a2982c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:14.905554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d150434-07ca-42e3-8cbc-206a2982c2dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:14.971691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:14.980956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d150434-07ca-42e3-8cbc-206a2982c2dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:14.982602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d150434-07ca-42e3-8cbc-206a2982c2dc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:15.098315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 154/316] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:15.103918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9f96e-4557-4226-a580-36982b00c035 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:15.141892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:15.212191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9f96e-4557-4226-a580-36982b00c035 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:15.248411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0677f-1740-4285-9e51-88d5ba7ebd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:15.249429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0677f-1740-4285-9e51-88d5ba7ebd85 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:15.249909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0677f-1740-4285-9e51-88d5ba7ebd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:15.250406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0677f-1740-4285-9e51-88d5ba7ebd85 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:15.252452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0677f-1740-4285-9e51-88d5ba7ebd85 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:15.254090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0677f-1740-4285-9e51-88d5ba7ebd85 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:15.256294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 163/317] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:15 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:15.262394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d150434-07ca-42e3-8cbc-206a2982c2dc None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:15.358986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:15.366254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d150434-07ca-42e3-8cbc-206a2982c2dc None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:15.403070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691b0f-2c5a-4812-ba51-8de4d680f475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:15.403620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691b0f-2c5a-4812-ba51-8de4d680f475 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:15.403898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691b0f-2c5a-4812-ba51-8de4d680f475 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:15.404171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691b0f-2c5a-4812-ba51-8de4d680f475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:15.404978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691b0f-2c5a-4812-ba51-8de4d680f475 None admin] RBAC: Adding query filter params (role.id=a7b8a3f8aa3a461782f12e263408b403, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb, user.id=1931d94b8c044a39878d538483b779e9) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:15.405287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691b0f-2c5a-4812-ba51-8de4d680f475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:15.406767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691b0f-2c5a-4812-ba51-8de4d680f475 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:15.413487 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 155/318] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:15 2022] GET /identity/v3/role_assignments?user.id=1931d94b8c044a39878d538483b779e9&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=a7b8a3f8aa3a461782f12e263408b403 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:15.774092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e95317-dc98-4fb8-9f7f-847ab4635e96 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:15.774399 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e95317-dc98-4fb8-9f7f-847ab4635e96 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:15.774675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e95317-dc98-4fb8-9f7f-847ab4635e96 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:15.776081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 164/319] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:15.780974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16401d-1beb-4490-ac11-3c8a0916e8ae None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:15.781262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16401d-1beb-4490-ac11-3c8a0916e8ae None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:15.781533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16401d-1beb-4490-ac11-3c8a0916e8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:15.799337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9d16401d-1beb-4490-ac11-3c8a0916e8ae None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:15.800523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9d16401d-1beb-4490-ac11-3c8a0916e8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:15.867238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 156/320] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:15.889646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e95317-dc98-4fb8-9f7f-847ab4635e96 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:15.992114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e95317-dc98-4fb8-9f7f-847ab4635e96 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:15.993684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:16.003919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cb585-18a1-452b-ac67-2237191713be None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.004427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cb585-18a1-452b-ac67-2237191713be None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.004544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cb585-18a1-452b-ac67-2237191713be None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.005962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 157/321] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:16.010758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8c355-270a-4de1-aef8-cbf76f961e0d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.011072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8c355-270a-4de1-aef8-cbf76f961e0d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.011346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8c355-270a-4de1-aef8-cbf76f961e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.029132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-99b8c355-270a-4de1-aef8-cbf76f961e0d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:16.030250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-99b8c355-270a-4de1-aef8-cbf76f961e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:16.030869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef8f0-7d73-4827-9b09-38ebb96ff10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:16.031524 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef8f0-7d73-4827-9b09-38ebb96ff10d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.031832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef8f0-7d73-4827-9b09-38ebb96ff10d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.032144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef8f0-7d73-4827-9b09-38ebb96ff10d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.033292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaef8f0-7d73-4827-9b09-38ebb96ff10d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:16.034728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaef8f0-7d73-4827-9b09-38ebb96ff10d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:16.036525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 165/322] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:16.041789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef8f0-7d73-4827-9b09-38ebb96ff10d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:16.099942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 158/323] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:16.122029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8c355-270a-4de1-aef8-cbf76f961e0d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:16.140943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:16.153040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef8f0-7d73-4827-9b09-38ebb96ff10d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:16.191415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962d6c-5ff9-4570-8626-60d1ba8b21c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:16.192030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962d6c-5ff9-4570-8626-60d1ba8b21c7 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.192310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962d6c-5ff9-4570-8626-60d1ba8b21c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.192583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962d6c-5ff9-4570-8626-60d1ba8b21c7 None admin] PATH_INFO: `/v3/groups` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.193256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962d6c-5ff9-4570-8626-60d1ba8b21c7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:16.194705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962d6c-5ff9-4570-8626-60d1ba8b21c7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:16.212448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 166/324] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Jul 27 07:36:16 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:36:16.236686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8c355-270a-4de1-aef8-cbf76f961e0d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:16.275906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65387c-c16e-4d19-96dc-d7f2f093928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:16.276574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65387c-c16e-4d19-96dc-d7f2f093928b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.276945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65387c-c16e-4d19-96dc-d7f2f093928b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.277136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65387c-c16e-4d19-96dc-d7f2f093928b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.289822 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65387c-c16e-4d19-96dc-d7f2f093928b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-af65387c-c16e-4d19-96dc-d7f2f093928b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:16.294921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:16.295865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:16.296649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:16.299053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 159/325] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:16.302752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962d6c-5ff9-4570-8626-60d1ba8b21c7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:16.338325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:16.421476 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962d6c-5ff9-4570-8626-60d1ba8b21c7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:16.460252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362fe58-1c4d-4a75-9682-f121c4db7331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:16.460888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fe58-1c4d-4a75-9682-f121c4db7331 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.461170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fe58-1c4d-4a75-9682-f121c4db7331 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.461446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fe58-1c4d-4a75-9682-f121c4db7331 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.462187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362fe58-1c4d-4a75-9682-f121c4db7331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:16.462577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362fe58-1c4d-4a75-9682-f121c4db7331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:16.463966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362fe58-1c4d-4a75-9682-f121c4db7331 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:16.474546 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 167/326] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:16.480253 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65387c-c16e-4d19-96dc-d7f2f093928b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:16.569528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:16.595428 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65387c-c16e-4d19-96dc-d7f2f093928b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:16.602015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ba8aa-aabd-4522-a25f-b832dd9277bf None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.602304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ba8aa-aabd-4522-a25f-b832dd9277bf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.602586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ba8aa-aabd-4522-a25f-b832dd9277bf None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.605217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 168/327] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:16.611050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e0da3-7291-437a-b426-06d88fb68f88 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.611340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e0da3-7291-437a-b426-06d88fb68f88 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.611619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e0da3-7291-437a-b426-06d88fb68f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.631574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6e0e0da3-7291-437a-b426-06d88fb68f88 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:16.632804 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6e0e0da3-7291-437a-b426-06d88fb68f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:16.636646 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b6451-a9db-4503-9ab1-6a8694e525ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:16.637303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6451-a9db-4503-9ab1-6a8694e525ed None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.637575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6451-a9db-4503-9ab1-6a8694e525ed None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.637841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6451-a9db-4503-9ab1-6a8694e525ed None admin] PATH_INFO: `/v3/users/a8c2f5dc5fdd41b0aa9d96c06744b9a1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.639078 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b6451-a9db-4503-9ab1-6a8694e525ed None admin] RBAC: Authorizing `identity:get_user(user_id=a8c2f5dc5fdd41b0aa9d96c06744b9a1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:16.640537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b6451-a9db-4503-9ab1-6a8694e525ed None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:16.642387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 160/328] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:16 2022] GET /identity/v3/users/a8c2f5dc5fdd41b0aa9d96c06744b9a1 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:16.648012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b6451-a9db-4503-9ab1-6a8694e525ed None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:16.718652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 169/329] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:16.745463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e0da3-7291-437a-b426-06d88fb68f88 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:16.765943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b6451-a9db-4503-9ab1-6a8694e525ed None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:16.774571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:16.815453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379cb9e-5cb6-431b-9546-240f599a55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:16.816281 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cb9e-5cb6-431b-9546-240f599a55b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.816556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cb9e-5cb6-431b-9546-240f599a55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.816821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cb9e-5cb6-431b-9546-240f599a55b9 None admin] PATH_INFO: `/v3/system/users/a8c2f5dc5fdd41b0aa9d96c06744b9a1/roles/a7b8a3f8aa3a461782f12e263408b403` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.818407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379cb9e-5cb6-431b-9546-240f599a55b9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a8c2f5dc5fdd41b0aa9d96c06744b9a1, role_id=a7b8a3f8aa3a461782f12e263408b403)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:16.820237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379cb9e-5cb6-431b-9546-240f599a55b9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:16.833538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 161/330] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Jul 27 07:36:16 2022] PUT /identity/v3/system/users/a8c2f5dc5fdd41b0aa9d96c06744b9a1/roles/a7b8a3f8aa3a461782f12e263408b403 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:36:16.874597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e0da3-7291-437a-b426-06d88fb68f88 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:16.926511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87a73e-a840-4118-a27d-222abad6fd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:16.927601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87a73e-a840-4118-a27d-222abad6fd1f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:16.928093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87a73e-a840-4118-a27d-222abad6fd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:16.928626 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87a73e-a840-4118-a27d-222abad6fd1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:16.947033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87a73e-a840-4118-a27d-222abad6fd1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9c87a73e-a840-4118-a27d-222abad6fd1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:16.952752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:16.953732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:16.954563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:16.959267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 170/331] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:16.968058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379cb9e-5cb6-431b-9546-240f599a55b9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:16.986414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:17.093997 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379cb9e-5cb6-431b-9546-240f599a55b9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:17.134966 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b5a94-0009-4f2b-9b69-3d24b3d5e777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:17.135935 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b5a94-0009-4f2b-9b69-3d24b3d5e777 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:17.136443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b5a94-0009-4f2b-9b69-3d24b3d5e777 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:17.136875 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b5a94-0009-4f2b-9b69-3d24b3d5e777 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:17.137619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b5a94-0009-4f2b-9b69-3d24b3d5e777 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:17.137926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b5a94-0009-4f2b-9b69-3d24b3d5e777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:17.139343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b5a94-0009-4f2b-9b69-3d24b3d5e777 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:17.149263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 162/332] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:17.155189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87a73e-a840-4118-a27d-222abad6fd1f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:17.256087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:17.276083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87a73e-a840-4118-a27d-222abad6fd1f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:17.320157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcd7bc-8ff5-4c5c-81c2-f44cef0164a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:17.320813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcd7bc-8ff5-4c5c-81c2-f44cef0164a8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:17.321160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcd7bc-8ff5-4c5c-81c2-f44cef0164a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:17.321444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcd7bc-8ff5-4c5c-81c2-f44cef0164a8 None admin] PATH_INFO: `/v3/users/50e41ee1bfbc4be38f32f5235ce39aa3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:17.322623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcd7bc-8ff5-4c5c-81c2-f44cef0164a8 None admin] RBAC: Authorizing `identity:get_user(user_id=50e41ee1bfbc4be38f32f5235ce39aa3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:17.324107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcd7bc-8ff5-4c5c-81c2-f44cef0164a8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:17.326078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 171/333] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:17 2022] GET /identity/v3/users/50e41ee1bfbc4be38f32f5235ce39aa3 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:17.332242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b5a94-0009-4f2b-9b69-3d24b3d5e777 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:17.421635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:17.467615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b5a94-0009-4f2b-9b69-3d24b3d5e777 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:17.513737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf217ce-318f-4af4-92cf-e888c9547423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:17.514374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf217ce-318f-4af4-92cf-e888c9547423 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:17.514656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf217ce-318f-4af4-92cf-e888c9547423 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:17.514968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf217ce-318f-4af4-92cf-e888c9547423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:17.515779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf217ce-318f-4af4-92cf-e888c9547423 None admin] RBAC: Adding query filter params (role.id=a53dca7201f54f8b841a25178a7e91a6, user.id=50e41ee1bfbc4be38f32f5235ce39aa3, scope.system=all) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:17.516113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf217ce-318f-4af4-92cf-e888c9547423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:17.517590 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf217ce-318f-4af4-92cf-e888c9547423 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:17.532874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 163/334] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jul 27 07:36:17 2022] GET /identity/v3/role_assignments?user.id=50e41ee1bfbc4be38f32f5235ce39aa3&scope.system=all&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:18.879170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f55c33-b3c3-4b60-a65c-83f249c86881 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:18.880143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f55c33-b3c3-4b60-a65c-83f249c86881 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:18.880648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f55c33-b3c3-4b60-a65c-83f249c86881 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:18.882596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 172/335] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:18.888251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafaf18-9b22-4809-8667-ef4f8e6ef54f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:18.889251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafaf18-9b22-4809-8667-ef4f8e6ef54f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:18.889756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafaf18-9b22-4809-8667-ef4f8e6ef54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:18.919928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1cafaf18-9b22-4809-8667-ef4f8e6ef54f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:18.921527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1cafaf18-9b22-4809-8667-ef4f8e6ef54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:19.029560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 164/336] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:19.073255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f55c33-b3c3-4b60-a65c-83f249c86881 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:19.206221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f55c33-b3c3-4b60-a65c-83f249c86881 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:19.249209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bff309-ea58-4286-93ec-a17374a9960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:19.250235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bff309-ea58-4286-93ec-a17374a9960b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:19.251301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bff309-ea58-4286-93ec-a17374a9960b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:19.251794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bff309-ea58-4286-93ec-a17374a9960b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:19.264467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bff309-ea58-4286-93ec-a17374a9960b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-23bff309-ea58-4286-93ec-a17374a9960b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:19.270346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:19.271235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:19.272046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:19.274858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 173/337] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:19.284338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafaf18-9b22-4809-8667-ef4f8e6ef54f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:19.353516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:19.396583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafaf18-9b22-4809-8667-ef4f8e6ef54f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:19.434412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52eae1-4c11-4eba-9580-2ca701effcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:19.435076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52eae1-4c11-4eba-9580-2ca701effcdf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:19.435359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52eae1-4c11-4eba-9580-2ca701effcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:19.435633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52eae1-4c11-4eba-9580-2ca701effcdf None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:19.436373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52eae1-4c11-4eba-9580-2ca701effcdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:19.436681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52eae1-4c11-4eba-9580-2ca701effcdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:19.438584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52eae1-4c11-4eba-9580-2ca701effcdf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:19.447958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 165/338] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:19.453870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bff309-ea58-4286-93ec-a17374a9960b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:19.468395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:19.570058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bff309-ea58-4286-93ec-a17374a9960b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:19.605584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052984fc-f4f5-45ca-8ef8-06506e17e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:19.606265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052984fc-f4f5-45ca-8ef8-06506e17e221 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:19.606549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052984fc-f4f5-45ca-8ef8-06506e17e221 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:19.606824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052984fc-f4f5-45ca-8ef8-06506e17e221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:19.678131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052984fc-f4f5-45ca-8ef8-06506e17e221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:19.680000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052984fc-f4f5-45ca-8ef8-06506e17e221 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:19.694485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:19.730958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ca9bf-da60-4f8f-8d17-b16224a9a83c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:19.731549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ca9bf-da60-4f8f-8d17-b16224a9a83c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:19.732043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ca9bf-da60-4f8f-8d17-b16224a9a83c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:19.733843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 166/339] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:19.739980 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974545c3-d5c3-4b4c-bff1-45ca9cc57645 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:19.740573 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974545c3-d5c3-4b4c-bff1-45ca9cc57645 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:19.741052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974545c3-d5c3-4b4c-bff1-45ca9cc57645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:19.765145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-974545c3-d5c3-4b4c-bff1-45ca9cc57645 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:19.766724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-974545c3-d5c3-4b4c-bff1-45ca9cc57645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:19.834638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 174/340] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 07:36:19.842150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052984fc-f4f5-45ca-8ef8-06506e17e221 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:19.852560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 167/341] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:19.881948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974545c3-d5c3-4b4c-bff1-45ca9cc57645 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:19.969283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:20.015245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052984fc-f4f5-45ca-8ef8-06506e17e221 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:20.030414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:20.067787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974545c3-d5c3-4b4c-bff1-45ca9cc57645 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:20.072648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78567842-ac16-4d8c-a4ba-80550a508878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:20.073517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78567842-ac16-4d8c-a4ba-80550a508878 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.078692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78567842-ac16-4d8c-a4ba-80550a508878 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.079178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78567842-ac16-4d8c-a4ba-80550a508878 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.082542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78567842-ac16-4d8c-a4ba-80550a508878 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:20.084352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78567842-ac16-4d8c-a4ba-80550a508878 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:20.087001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 175/342] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:19 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:20.088475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce06d6-d257-4b1e-9abf-22830727c595 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.088759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce06d6-d257-4b1e-9abf-22830727c595 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.089022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce06d6-d257-4b1e-9abf-22830727c595 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.092013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 176/343] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:20.098604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111942c-cdb4-4ce9-bf8b-bbf6a5a0264c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.098900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111942c-cdb4-4ce9-bf8b-bbf6a5a0264c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.099185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111942c-cdb4-4ce9-bf8b-bbf6a5a0264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.133821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e111942c-cdb4-4ce9-bf8b-bbf6a5a0264c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:20.135054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e111942c-cdb4-4ce9-bf8b-bbf6a5a0264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:20.141683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dff2c6-38f0-4aa6-a2e6-02f1f6624c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:20.142342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dff2c6-38f0-4aa6-a2e6-02f1f6624c3e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.142617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dff2c6-38f0-4aa6-a2e6-02f1f6624c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.142928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dff2c6-38f0-4aa6-a2e6-02f1f6624c3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.167415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dff2c6-38f0-4aa6-a2e6-02f1f6624c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-29dff2c6-38f0-4aa6-a2e6-02f1f6624c3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:20.179208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:20.180090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:20.181324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 168/344] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:20.182145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dff2c6-38f0-4aa6-a2e6-02f1f6624c3e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:20.259449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 177/345] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:20.260099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111942c-cdb4-4ce9-bf8b-bbf6a5a0264c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:20.371339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111942c-cdb4-4ce9-bf8b-bbf6a5a0264c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:20.381626 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:20.410246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e7edd-abde-4a85-a7c7-4dbadd5fdbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:20.411303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7edd-abde-4a85-a7c7-4dbadd5fdbad None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.411641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7edd-abde-4a85-a7c7-4dbadd5fdbad None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.411912 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7edd-abde-4a85-a7c7-4dbadd5fdbad None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.412738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e7edd-abde-4a85-a7c7-4dbadd5fdbad None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:20.413043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e7edd-abde-4a85-a7c7-4dbadd5fdbad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:20.414426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e7edd-abde-4a85-a7c7-4dbadd5fdbad None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:20.441231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 178/346] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:20.442122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e7edd-abde-4a85-a7c7-4dbadd5fdbad None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:20.461861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dff2c6-38f0-4aa6-a2e6-02f1f6624c3e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:20.495200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:20.554754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e7edd-abde-4a85-a7c7-4dbadd5fdbad None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:20.582331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de043bd5-795e-4671-8e25-955d5db70abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:20.583420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de043bd5-795e-4671-8e25-955d5db70abd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.583926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de043bd5-795e-4671-8e25-955d5db70abd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.584518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de043bd5-795e-4671-8e25-955d5db70abd None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.592915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de043bd5-795e-4671-8e25-955d5db70abd None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:20.595731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de043bd5-795e-4671-8e25-955d5db70abd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:20.598558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 169/347] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:20 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:20.599680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de043bd5-795e-4671-8e25-955d5db70abd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:20.602493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd014108-896b-4a10-818f-61bb2ecdbbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:20.603811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd014108-896b-4a10-818f-61bb2ecdbbdc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.604089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd014108-896b-4a10-818f-61bb2ecdbbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.604360 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd014108-896b-4a10-818f-61bb2ecdbbdc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.617456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd014108-896b-4a10-818f-61bb2ecdbbdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-dd014108-896b-4a10-818f-61bb2ecdbbdc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:20.622952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:20.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:20.624882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 179/348] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:36:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:20.625620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3960f-cdda-4af5-80df-c009373b6323 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.625686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3960f-cdda-4af5-80df-c009373b6323 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.625919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3960f-cdda-4af5-80df-c009373b6323 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.627191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 180/349] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:20.631790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41cc4-5e0d-48d6-bf03-f8fab8a026a7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.632225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41cc4-5e0d-48d6-bf03-f8fab8a026a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.632632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41cc4-5e0d-48d6-bf03-f8fab8a026a7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.634061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 181/350] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:20.634977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41cc4-5e0d-48d6-bf03-f8fab8a026a7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:20.684146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:20.743052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de043bd5-795e-4671-8e25-955d5db70abd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:20.774407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41cc4-5e0d-48d6-bf03-f8fab8a026a7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:20.782533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf99add-a42b-4a83-8a5f-a560b2e56702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:20.783988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf99add-a42b-4a83-8a5f-a560b2e56702 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.783988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf99add-a42b-4a83-8a5f-a560b2e56702 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.783988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf99add-a42b-4a83-8a5f-a560b2e56702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.820102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a605a3-0c4d-42c8-ba09-beb2bde58c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:20.820730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a605a3-0c4d-42c8-ba09-beb2bde58c3e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:20.821007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a605a3-0c4d-42c8-ba09-beb2bde58c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:20.821280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a605a3-0c4d-42c8-ba09-beb2bde58c3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:20.822086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a605a3-0c4d-42c8-ba09-beb2bde58c3e None admin] RBAC: Adding query filter params (group.id=a2db5c7e1da546a1a71d39b43aa37dc8, role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=bfc55faa34394f559d12491d3fb33989) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:20.822389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a605a3-0c4d-42c8-ba09-beb2bde58c3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:20.823864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a605a3-0c4d-42c8-ba09-beb2bde58c3e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:20.833833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 182/351] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:20 2022] GET /identity/v3/role_assignments?group.id=a2db5c7e1da546a1a71d39b43aa37dc8&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:20.834990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a605a3-0c4d-42c8-ba09-beb2bde58c3e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:20.858277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:20.895775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf99add-a42b-4a83-8a5f-a560b2e56702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:20.898266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf99add-a42b-4a83-8a5f-a560b2e56702 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:20.966966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:20.978159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a605a3-0c4d-42c8-ba09-beb2bde58c3e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:21.030839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ea488-1781-45f6-b4f9-30ca226c2328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:21.031539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea488-1781-45f6-b4f9-30ca226c2328 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.032019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea488-1781-45f6-b4f9-30ca226c2328 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.032473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea488-1781-45f6-b4f9-30ca226c2328 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.033362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ea488-1781-45f6-b4f9-30ca226c2328 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:21.033814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ea488-1781-45f6-b4f9-30ca226c2328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:21.035101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 170/352] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:21.035502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ea488-1781-45f6-b4f9-30ca226c2328 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:21.037027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d24e1-6a42-4f35-bfbf-9737d1bce1f4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.037542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d24e1-6a42-4f35-bfbf-9737d1bce1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.037993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d24e1-6a42-4f35-bfbf-9737d1bce1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.046282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 183/353] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:21.046755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85af26-ffc0-44ff-b119-79a315af0088 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.047072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85af26-ffc0-44ff-b119-79a315af0088 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.047391 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85af26-ffc0-44ff-b119-79a315af0088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.058857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c56d24e1-6a42-4f35-bfbf-9737d1bce1f4 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:21.060087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c56d24e1-6a42-4f35-bfbf-9737d1bce1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:21.071221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3d85af26-ffc0-44ff-b119-79a315af0088 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:21.072420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d85af26-ffc0-44ff-b119-79a315af0088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:21.134419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 171/354] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:21.135742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf5cf-2ddd-443b-b4e0-a683343bd21e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.136028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf5cf-2ddd-443b-b4e0-a683343bd21e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.136282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf5cf-2ddd-443b-b4e0-a683343bd21e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.137538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 172/355] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:21.138229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cf5cf-2ddd-443b-b4e0-a683343bd21e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:21.152561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:21.161049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 184/356] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:21.161744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85af26-ffc0-44ff-b119-79a315af0088 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:21.274197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:21.282594 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cf5cf-2ddd-443b-b4e0-a683343bd21e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:21.293718 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85af26-ffc0-44ff-b119-79a315af0088 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:21.336951 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc68df-d09f-4087-a6f9-ed2fb5055904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:21.337725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc68df-d09f-4087-a6f9-ed2fb5055904 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.338095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc68df-d09f-4087-a6f9-ed2fb5055904 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.338491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc68df-d09f-4087-a6f9-ed2fb5055904 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.340372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc68df-d09f-4087-a6f9-ed2fb5055904 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:21.341269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433573df-3b41-41bb-a62e-6fe0e3a239fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:21.341897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433573df-3b41-41bb-a62e-6fe0e3a239fc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.342083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc68df-d09f-4087-a6f9-ed2fb5055904 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:21.342182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433573df-3b41-41bb-a62e-6fe0e3a239fc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.342438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433573df-3b41-41bb-a62e-6fe0e3a239fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.344065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 173/357] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:21 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:21.350921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247c59e-5b63-4e36-929f-e413742ff459 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.351260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247c59e-5b63-4e36-929f-e413742ff459 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.351528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247c59e-5b63-4e36-929f-e413742ff459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.372165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4247c59e-5b63-4e36-929f-e413742ff459 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:21.373409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4247c59e-5b63-4e36-929f-e413742ff459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:21.434476 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433573df-3b41-41bb-a62e-6fe0e3a239fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:21.436213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433573df-3b41-41bb-a62e-6fe0e3a239fc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:21.470919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 174/358] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:21.471882 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247c59e-5b63-4e36-929f-e413742ff459 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:21.477417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:21.559376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:21.576460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 185/359] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:21.577599 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433573df-3b41-41bb-a62e-6fe0e3a239fc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:21.604510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247c59e-5b63-4e36-929f-e413742ff459 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:21.652670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1387d-b739-492a-a228-aad33c48d383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:21.653486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1387d-b739-492a-a228-aad33c48d383 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.653767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1387d-b739-492a-a228-aad33c48d383 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.654031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1387d-b739-492a-a228-aad33c48d383 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.665899 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1387d-b739-492a-a228-aad33c48d383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-87b1387d-b739-492a-a228-aad33c48d383 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:21.671924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:21.672867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:21.673645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 175/360] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:21.674273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1387d-b739-492a-a228-aad33c48d383 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:21.716279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433573df-3b41-41bb-a62e-6fe0e3a239fc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:21.758796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:21.763791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fca41-56ef-4a9e-bf12-9b138bc8cc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:21.764608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fca41-56ef-4a9e-bf12-9b138bc8cc75 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.764929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fca41-56ef-4a9e-bf12-9b138bc8cc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.765722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fca41-56ef-4a9e-bf12-9b138bc8cc75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.782215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fca41-56ef-4a9e-bf12-9b138bc8cc75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-cc9fca41-56ef-4a9e-bf12-9b138bc8cc75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:21.785882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:21.786854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 186/361] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:36:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:21.788461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fca41-56ef-4a9e-bf12-9b138bc8cc75 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:21.819157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1387d-b739-492a-a228-aad33c48d383 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:21.856881 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:21.876236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634f1fc-0eb9-4bc6-a0b6-569704caee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:21.876992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634f1fc-0eb9-4bc6-a0b6-569704caee94 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.877277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634f1fc-0eb9-4bc6-a0b6-569704caee94 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.877550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634f1fc-0eb9-4bc6-a0b6-569704caee94 None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.878753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634f1fc-0eb9-4bc6-a0b6-569704caee94 None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:21.880266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634f1fc-0eb9-4bc6-a0b6-569704caee94 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:21.881943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 176/362] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:21 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:21.882645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634f1fc-0eb9-4bc6-a0b6-569704caee94 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:21.933428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fca41-56ef-4a9e-bf12-9b138bc8cc75 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:21.981266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf13e5-c5b5-466e-ab2c-8b502bd1daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:21.981644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf13e5-c5b5-466e-ab2c-8b502bd1daa2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:21.981921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf13e5-c5b5-466e-ab2c-8b502bd1daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:21.982184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf13e5-c5b5-466e-ab2c-8b502bd1daa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:21.996851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf13e5-c5b5-466e-ab2c-8b502bd1daa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3caf13e5-c5b5-466e-ab2c-8b502bd1daa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:22.003531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:22.004461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:22.005243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 187/363] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:22.007419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf13e5-c5b5-466e-ab2c-8b502bd1daa2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:22.021747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634f1fc-0eb9-4bc6-a0b6-569704caee94 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:22.064676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:22.070606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab98a45-0a7a-43b3-a8ef-31c85c16cb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:22.071429 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab98a45-0a7a-43b3-a8ef-31c85c16cb94 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:22.071715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab98a45-0a7a-43b3-a8ef-31c85c16cb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:22.071990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab98a45-0a7a-43b3-a8ef-31c85c16cb94 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:22.073308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab98a45-0a7a-43b3-a8ef-31c85c16cb94 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:22.074829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab98a45-0a7a-43b3-a8ef-31c85c16cb94 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:22.076640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 177/364] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:21 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:22.077450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab98a45-0a7a-43b3-a8ef-31c85c16cb94 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:22.142433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf13e5-c5b5-466e-ab2c-8b502bd1daa2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:22.156820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:22.195984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffa486-d447-44dd-af03-eac0478874cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:22.197118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffa486-d447-44dd-af03-eac0478874cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:22.197118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffa486-d447-44dd-af03-eac0478874cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:22.197118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffa486-d447-44dd-af03-eac0478874cd None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:22.197873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffa486-d447-44dd-af03-eac0478874cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:22.198180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffa486-d447-44dd-af03-eac0478874cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:22.199651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffa486-d447-44dd-af03-eac0478874cd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:22.212502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 188/365] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:22.213369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffa486-d447-44dd-af03-eac0478874cd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:22.224804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab98a45-0a7a-43b3-a8ef-31c85c16cb94 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:22.267886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d82c8a-d58a-4951-b85d-3eb0306a23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:22.268529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d82c8a-d58a-4951-b85d-3eb0306a23cd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:22.268868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d82c8a-d58a-4951-b85d-3eb0306a23cd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:22.269207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d82c8a-d58a-4951-b85d-3eb0306a23cd None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:22.270001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d82c8a-d58a-4951-b85d-3eb0306a23cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:22.270367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d82c8a-d58a-4951-b85d-3eb0306a23cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:22.271860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d82c8a-d58a-4951-b85d-3eb0306a23cd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:22.282483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 178/366] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:22.283417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d82c8a-d58a-4951-b85d-3eb0306a23cd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:22.349326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffa486-d447-44dd-af03-eac0478874cd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:22.362941 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:22.394206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd3ced-3df7-488a-b411-941b396cb290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:22.394839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd3ced-3df7-488a-b411-941b396cb290 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:22.395153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd3ced-3df7-488a-b411-941b396cb290 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:22.395430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd3ced-3df7-488a-b411-941b396cb290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:22.396273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd3ced-3df7-488a-b411-941b396cb290 None admin] RBAC: Adding query filter params (group.id=a2db5c7e1da546a1a71d39b43aa37dc8, role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:22.396587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd3ced-3df7-488a-b411-941b396cb290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:22.398039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd3ced-3df7-488a-b411-941b396cb290 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:22.404395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 189/367] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:22 2022] GET /identity/v3/role_assignments?group.id=a2db5c7e1da546a1a71d39b43aa37dc8&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:22.406012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd3ced-3df7-488a-b411-941b396cb290 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:22.416315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d82c8a-d58a-4951-b85d-3eb0306a23cd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:22.466253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:22.475645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8704d5-6445-4efe-914a-c237ed0003c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:22.476605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8704d5-6445-4efe-914a-c237ed0003c9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:22.477054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8704d5-6445-4efe-914a-c237ed0003c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:22.477496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8704d5-6445-4efe-914a-c237ed0003c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:22.478497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8704d5-6445-4efe-914a-c237ed0003c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:22.479046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8704d5-6445-4efe-914a-c237ed0003c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:22.481335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8704d5-6445-4efe-914a-c237ed0003c9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:22.494298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 179/368] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:22.495636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8704d5-6445-4efe-914a-c237ed0003c9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:22.557939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd3ced-3df7-488a-b411-941b396cb290 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:22.603944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618b353-7e61-4d3b-a9fc-9ceb1775ca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:22.604712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618b353-7e61-4d3b-a9fc-9ceb1775ca74 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:22.605088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618b353-7e61-4d3b-a9fc-9ceb1775ca74 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:22.605433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618b353-7e61-4d3b-a9fc-9ceb1775ca74 None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:22.606913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618b353-7e61-4d3b-a9fc-9ceb1775ca74 None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:22.608417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618b353-7e61-4d3b-a9fc-9ceb1775ca74 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:22.614586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 190/369] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:22 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:22.614586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618b353-7e61-4d3b-a9fc-9ceb1775ca74 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:22.646316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8704d5-6445-4efe-914a-c237ed0003c9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:22.678639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:22.689502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d620d-ca1d-4ca1-82be-cb7d0253f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:22.690151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d620d-ca1d-4ca1-82be-cb7d0253f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:22.690428 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d620d-ca1d-4ca1-82be-cb7d0253f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:22.690693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d620d-ca1d-4ca1-82be-cb7d0253f5b5 None admin] PATH_INFO: `/v3/users/a8c2f5dc5fdd41b0aa9d96c06744b9a1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:22.691995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d620d-ca1d-4ca1-82be-cb7d0253f5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=a8c2f5dc5fdd41b0aa9d96c06744b9a1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:22.693421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d620d-ca1d-4ca1-82be-cb7d0253f5b5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:22.695383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 180/370] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:36:22 2022] GET /identity/v3/users/a8c2f5dc5fdd41b0aa9d96c06744b9a1 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:22.696117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d620d-ca1d-4ca1-82be-cb7d0253f5b5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:22.748639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:22.752897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618b353-7e61-4d3b-a9fc-9ceb1775ca74 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:22.801539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ea62-0467-41d6-a7ac-7470cceef8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:22.802166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ea62-0467-41d6-a7ac-7470cceef8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:22.802441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ea62-0467-41d6-a7ac-7470cceef8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:22.802964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ea62-0467-41d6-a7ac-7470cceef8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:22.857578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d620d-ca1d-4ca1-82be-cb7d0253f5b5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:22.906409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648ea62-0467-41d6-a7ac-7470cceef8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:22.908777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648ea62-0467-41d6-a7ac-7470cceef8e2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:22.909723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7161e-539d-48f4-b85e-a34639c67eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:22.910356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7161e-539d-48f4-b85e-a34639c67eff None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:22.910633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7161e-539d-48f4-b85e-a34639c67eff None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:22.910963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7161e-539d-48f4-b85e-a34639c67eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:22.996780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:23.015942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7161e-539d-48f4-b85e-a34639c67eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:23.018109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7161e-539d-48f4-b85e-a34639c67eff None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:23.036210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:23.044031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 191/371] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:23.044031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ea62-0467-41d6-a7ac-7470cceef8e2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:23.169597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 181/372] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:23.171361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7161e-539d-48f4-b85e-a34639c67eff None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:23.196684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ea62-0467-41d6-a7ac-7470cceef8e2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:23.241965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c18a9-c960-41b4-b74a-df7bf70f815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:23.242571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c18a9-c960-41b4-b74a-df7bf70f815c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:23.242850 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c18a9-c960-41b4-b74a-df7bf70f815c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:23.243148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c18a9-c960-41b4-b74a-df7bf70f815c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:23.243943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c18a9-c960-41b4-b74a-df7bf70f815c None admin] RBAC: Adding query filter params (group.id=a2db5c7e1da546a1a71d39b43aa37dc8, role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=bfc55faa34394f559d12491d3fb33989) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:23.244245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c18a9-c960-41b4-b74a-df7bf70f815c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:23.245695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c18a9-c960-41b4-b74a-df7bf70f815c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:23.251697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 192/373] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:23 2022] GET /identity/v3/role_assignments?group.id=a2db5c7e1da546a1a71d39b43aa37dc8&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:23.252502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c18a9-c960-41b4-b74a-df7bf70f815c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:23.304415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:23.316506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7161e-539d-48f4-b85e-a34639c67eff None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:23.348297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:23.361945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb160-5865-46be-9b5f-53955febfbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:23.362912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb160-5865-46be-9b5f-53955febfbef None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:23.363374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb160-5865-46be-9b5f-53955febfbef None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:23.363846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb160-5865-46be-9b5f-53955febfbef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:23.364849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb160-5865-46be-9b5f-53955febfbef None admin] RBAC: Adding query filter params (role.id=a7b8a3f8aa3a461782f12e263408b403, user.id=a8c2f5dc5fdd41b0aa9d96c06744b9a1, scope.system=all) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:23.365378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb160-5865-46be-9b5f-53955febfbef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:23.366860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb160-5865-46be-9b5f-53955febfbef None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:23.384089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 182/374] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jul 27 07:36:23 2022] GET /identity/v3/role_assignments?user.id=a8c2f5dc5fdd41b0aa9d96c06744b9a1&scope.system=all&role.id=a7b8a3f8aa3a461782f12e263408b403 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:23.385361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd733fe6-6e16-4f31-9c7a-28ec2c572adb None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:23.385649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd733fe6-6e16-4f31-9c7a-28ec2c572adb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:23.385922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd733fe6-6e16-4f31-9c7a-28ec2c572adb None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:23.391927 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 183/375] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:23.392939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd733fe6-6e16-4f31-9c7a-28ec2c572adb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:23.407269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c18a9-c960-41b4-b74a-df7bf70f815c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:23.472185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab2c85-1654-4670-8e30-4a07ca0e4d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:23.474325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab2c85-1654-4670-8e30-4a07ca0e4d1c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:23.475401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab2c85-1654-4670-8e30-4a07ca0e4d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:23.475872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab2c85-1654-4670-8e30-4a07ca0e4d1c None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:23.477675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab2c85-1654-4670-8e30-4a07ca0e4d1c None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:23.480159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab2c85-1654-4670-8e30-4a07ca0e4d1c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:23.483119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 193/376] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:23 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:23.484486 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6f11a-5026-4f3f-8aa3-2a4ac8fe1450 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:23.484806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6f11a-5026-4f3f-8aa3-2a4ac8fe1450 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:23.485111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6f11a-5026-4f3f-8aa3-2a4ac8fe1450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:23.528197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-01b6f11a-5026-4f3f-8aa3-2a4ac8fe1450 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:23.529524 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-01b6f11a-5026-4f3f-8aa3-2a4ac8fe1450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:23.586563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd733fe6-6e16-4f31-9c7a-28ec2c572adb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:23.625455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 194/377] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:23.626156 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6f11a-5026-4f3f-8aa3-2a4ac8fe1450 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:23.631590 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a751c34-78ba-485b-99e8-0646c7e88e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:23.632252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a751c34-78ba-485b-99e8-0646c7e88e61 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:23.632529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a751c34-78ba-485b-99e8-0646c7e88e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:23.632799 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a751c34-78ba-485b-99e8-0646c7e88e61 None admin] PATH_INFO: `/v3/projects/b01056c5a4f74067a3bc2250b32736cc` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:23.634224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a751c34-78ba-485b-99e8-0646c7e88e61 None admin] RBAC: Authorizing `identity:get_project(project_id=b01056c5a4f74067a3bc2250b32736cc)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:23.635689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a751c34-78ba-485b-99e8-0646c7e88e61 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:23.638316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 184/378] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:23 2022] GET /identity/v3/projects/b01056c5a4f74067a3bc2250b32736cc => generated 344 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:23.646215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a751c34-78ba-485b-99e8-0646c7e88e61 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:23.670924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:23.735573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:23.782571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a751c34-78ba-485b-99e8-0646c7e88e61 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:23.787963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6f11a-5026-4f3f-8aa3-2a4ac8fe1450 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:23.828519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b041737-20ac-475b-a397-6b1c96391bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:23.830070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041737-20ac-475b-a397-6b1c96391bde None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:23.830409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041737-20ac-475b-a397-6b1c96391bde None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:23.830680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041737-20ac-475b-a397-6b1c96391bde None admin] PATH_INFO: `/v3/groups/8361a35e68d4415b8525a6541aca5e73` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:23.834518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93fd90-dcd2-420d-898b-79e0579a62b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:23.835208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93fd90-dcd2-420d-898b-79e0579a62b2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:23.835658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93fd90-dcd2-420d-898b-79e0579a62b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:23.835947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93fd90-dcd2-420d-898b-79e0579a62b2 None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:23.836064 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b041737-20ac-475b-a397-6b1c96391bde None admin] RBAC: Authorizing `identity:get_group(group_id=8361a35e68d4415b8525a6541aca5e73)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:23.837141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93fd90-dcd2-420d-898b-79e0579a62b2 None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:23.837506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b041737-20ac-475b-a397-6b1c96391bde None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:23.838579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93fd90-dcd2-420d-898b-79e0579a62b2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:23.839471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 185/379] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:23 2022] GET /identity/v3/groups/8361a35e68d4415b8525a6541aca5e73 => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:23.840250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b041737-20ac-475b-a397-6b1c96391bde None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:23.840477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 195/380] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:23 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:23.846390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93fd90-dcd2-420d-898b-79e0579a62b2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:23.949942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:23.974521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b041737-20ac-475b-a397-6b1c96391bde None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:23.981746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93fd90-dcd2-420d-898b-79e0579a62b2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:24.017588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6e663-b4c4-4aad-9e13-4d1009ba02cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:24.018304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6e663-b4c4-4aad-9e13-4d1009ba02cb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:24.018654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6e663-b4c4-4aad-9e13-4d1009ba02cb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:24.019048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6e663-b4c4-4aad-9e13-4d1009ba02cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:24.023493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:24.036763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6e663-b4c4-4aad-9e13-4d1009ba02cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:24.039625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb6b4-1d94-48af-bade-7f6502848ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:24.040537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb6b4-1d94-48af-bade-7f6502848ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:24.041016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb6b4-1d94-48af-bade-7f6502848ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:24.041488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb6b4-1d94-48af-bade-7f6502848ef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-43b6e663-b4c4-4aad-9e13-4d1009ba02cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:24.042166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:24.043352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:24.044197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 186/381] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:24.044886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6e663-b4c4-4aad-9e13-4d1009ba02cb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:24.046013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eb6b4-1d94-48af-bade-7f6502848ef8 None admin] RBAC: Adding query filter params (group.id=8361a35e68d4415b8525a6541aca5e73, role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=b01056c5a4f74067a3bc2250b32736cc) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:24.046543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eb6b4-1d94-48af-bade-7f6502848ef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:24.051534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eb6b4-1d94-48af-bade-7f6502848ef8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:24.058721 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 196/382] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:23 2022] GET /identity/v3/role_assignments?group.id=8361a35e68d4415b8525a6541aca5e73&scope.project.id=b01056c5a4f74067a3bc2250b32736cc&role.id=2ba3b2926541436a9d26782420538af3 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:24.060152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb6b4-1d94-48af-bade-7f6502848ef8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:24.212855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6e663-b4c4-4aad-9e13-4d1009ba02cb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:24.254531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fa5d5-d048-4577-a1f0-7472e99886a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:24.255556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa5d5-d048-4577-a1f0-7472e99886a5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:24.256055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa5d5-d048-4577-a1f0-7472e99886a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:24.256536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa5d5-d048-4577-a1f0-7472e99886a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:24.257729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fa5d5-d048-4577-a1f0-7472e99886a5 None admin] RBAC: Adding query filter params (group.id=a2db5c7e1da546a1a71d39b43aa37dc8, role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:24.258308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fa5d5-d048-4577-a1f0-7472e99886a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:24.260162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fa5d5-d048-4577-a1f0-7472e99886a5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:24.267117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 187/383] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:24 2022] GET /identity/v3/role_assignments?group.id=a2db5c7e1da546a1a71d39b43aa37dc8&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:24.306261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb6b4-1d94-48af-bade-7f6502848ef8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:24.356080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8837-0725-4abc-8387-c8edb881c7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:24.356722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8837-0725-4abc-8387-c8edb881c7ae None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:24.356998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8837-0725-4abc-8387-c8edb881c7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:24.357265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8837-0725-4abc-8387-c8edb881c7ae None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:24.358005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8837-0725-4abc-8387-c8edb881c7ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:24.358307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8837-0725-4abc-8387-c8edb881c7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:24.360269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8837-0725-4abc-8387-c8edb881c7ae None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:24.375962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 197/384] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:24.381874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fa5d5-d048-4577-a1f0-7472e99886a5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:24.397058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:24.533811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fa5d5-d048-4577-a1f0-7472e99886a5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:24.577574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fefdcb-3244-4c15-a098-e95020396156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:24.578235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fefdcb-3244-4c15-a098-e95020396156 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:24.578571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fefdcb-3244-4c15-a098-e95020396156 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:24.579364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fefdcb-3244-4c15-a098-e95020396156 None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:24.580546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fefdcb-3244-4c15-a098-e95020396156 None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:24.582002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fefdcb-3244-4c15-a098-e95020396156 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:24.583949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 188/385] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:24 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:24.589441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8837-0725-4abc-8387-c8edb881c7ae None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:24.692591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:24.706938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02b24-c296-4073-8359-981b3db8f5f5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:24.707341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02b24-c296-4073-8359-981b3db8f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:24.707741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02b24-c296-4073-8359-981b3db8f5f5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:24.709194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 189/386] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:24.723728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888acba-3311-4b0c-9ccd-828e89352dd0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:24.724054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888acba-3311-4b0c-9ccd-828e89352dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:24.724280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888acba-3311-4b0c-9ccd-828e89352dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:24.754455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8837-0725-4abc-8387-c8edb881c7ae None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:24.776005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7888acba-3311-4b0c-9ccd-828e89352dd0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:24.777219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7888acba-3311-4b0c-9ccd-828e89352dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:24.801055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3b60d-88d1-4b24-a060-82981a0cad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:24.801719 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3b60d-88d1-4b24-a060-82981a0cad81 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:24.802001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3b60d-88d1-4b24-a060-82981a0cad81 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:24.802275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3b60d-88d1-4b24-a060-82981a0cad81 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:24.807641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3b60d-88d1-4b24-a060-82981a0cad81 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:24.809112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3b60d-88d1-4b24-a060-82981a0cad81 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:24.811028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 198/387] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:24 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:24.817999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3b60d-88d1-4b24-a060-82981a0cad81 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:24.884192 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 190/388] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:24.918664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888acba-3311-4b0c-9ccd-828e89352dd0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:24.923217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:24.993973 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3b60d-88d1-4b24-a060-82981a0cad81 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:25.034050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:25.056489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea941dce-68bd-445a-91f0-4c31c62b04d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:25.057163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea941dce-68bd-445a-91f0-4c31c62b04d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:25.057442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea941dce-68bd-445a-91f0-4c31c62b04d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:25.057717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea941dce-68bd-445a-91f0-4c31c62b04d7 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989/groups/a2db5c7e1da546a1a71d39b43aa37dc8/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:25.060325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea941dce-68bd-445a-91f0-4c31c62b04d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc55faa34394f559d12491d3fb33989, group_id=a2db5c7e1da546a1a71d39b43aa37dc8, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:25.061777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea941dce-68bd-445a-91f0-4c31c62b04d7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:25.068907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888acba-3311-4b0c-9ccd-828e89352dd0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:25.076157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 199/389] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 27 07:36:24 2022] PUT /identity/v3/projects/bfc55faa34394f559d12491d3fb33989/groups/a2db5c7e1da546a1a71d39b43aa37dc8/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:36:25.139392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf983d1-44eb-4902-9a5d-c1f79f195175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:25.139961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf983d1-44eb-4902-9a5d-c1f79f195175 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:25.140244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf983d1-44eb-4902-9a5d-c1f79f195175 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:25.140514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf983d1-44eb-4902-9a5d-c1f79f195175 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:25.158091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf983d1-44eb-4902-9a5d-c1f79f195175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-acf983d1-44eb-4902-9a5d-c1f79f195175 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:25.163118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:25.163973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:25.164775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 191/390] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:25.170242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea941dce-68bd-445a-91f0-4c31c62b04d7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:25.318065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea941dce-68bd-445a-91f0-4c31c62b04d7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:25.358664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ce95e-2e0e-46c0-b2ed-99b0752b6b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:25.360295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ce95e-2e0e-46c0-b2ed-99b0752b6b8d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:25.360784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ce95e-2e0e-46c0-b2ed-99b0752b6b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:25.361252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ce95e-2e0e-46c0-b2ed-99b0752b6b8d None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:25.362166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ce95e-2e0e-46c0-b2ed-99b0752b6b8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:25.362676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ce95e-2e0e-46c0-b2ed-99b0752b6b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:25.364294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ce95e-2e0e-46c0-b2ed-99b0752b6b8d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:25.373671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 200/391] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:25.378985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf983d1-44eb-4902-9a5d-c1f79f195175 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:25.451419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:25.491819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf983d1-44eb-4902-9a5d-c1f79f195175 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:25.530121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ab367-430d-472e-8a16-90a677a10442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:25.530817 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab367-430d-472e-8a16-90a677a10442 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:25.531149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab367-430d-472e-8a16-90a677a10442 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:25.531937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab367-430d-472e-8a16-90a677a10442 None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:25.533116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ab367-430d-472e-8a16-90a677a10442 None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:25.534553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ab367-430d-472e-8a16-90a677a10442 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:25.536504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 192/392] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:25 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:25.541943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ce95e-2e0e-46c0-b2ed-99b0752b6b8d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:25.594427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:25.669651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ce95e-2e0e-46c0-b2ed-99b0752b6b8d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:25.711756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ef5ea-be57-462e-abff-d980ec0d4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:25.712311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ef5ea-be57-462e-abff-d980ec0d4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:25.712585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ef5ea-be57-462e-abff-d980ec0d4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:25.712907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ef5ea-be57-462e-abff-d980ec0d4fc3 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:25.715665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ef5ea-be57-462e-abff-d980ec0d4fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:25.717124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ef5ea-be57-462e-abff-d980ec0d4fc3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:25.718829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 201/393] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:25 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:25.729433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ab367-430d-472e-8a16-90a677a10442 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:25.845160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ab367-430d-472e-8a16-90a677a10442 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:25.879581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:25.882389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31f9f7-637b-4755-b868-4bbd84079ff2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:25.882679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31f9f7-637b-4755-b868-4bbd84079ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:25.882867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224be42-b6e2-45d8-b4a9-a5e7e41a1387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:25.882997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31f9f7-637b-4755-b868-4bbd84079ff2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:25.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224be42-b6e2-45d8-b4a9-a5e7e41a1387 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:25.883848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224be42-b6e2-45d8-b4a9-a5e7e41a1387 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:25.884115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224be42-b6e2-45d8-b4a9-a5e7e41a1387 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/groups/a2db5c7e1da546a1a71d39b43aa37dc8/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:25.886378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224be42-b6e2-45d8-b4a9-a5e7e41a1387 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebaa0703dbbd4070aa41106cffcba1fb, group_id=a2db5c7e1da546a1a71d39b43aa37dc8, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:25.887145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 202/394] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:25.888160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224be42-b6e2-45d8-b4a9-a5e7e41a1387 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:25.892094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f7e1-c461-4538-af88-2d9c27162ac1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:25.892531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f7e1-c461-4538-af88-2d9c27162ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:25.892886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f7e1-c461-4538-af88-2d9c27162ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:25.904163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 193/395] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 27 07:36:25 2022] PUT /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/groups/a2db5c7e1da546a1a71d39b43aa37dc8/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:25.925410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-93a2f7e1-c461-4538-af88-2d9c27162ac1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:25.926753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-93a2f7e1-c461-4538-af88-2d9c27162ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:26.042728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 203/396] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:26.066005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224be42-b6e2-45d8-b4a9-a5e7e41a1387 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:26.171559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224be42-b6e2-45d8-b4a9-a5e7e41a1387 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:26.212989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba851-b722-42ed-a07a-2d18dc68d5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:26.213649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba851-b722-42ed-a07a-2d18dc68d5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:26.213932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba851-b722-42ed-a07a-2d18dc68d5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:26.214209 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba851-b722-42ed-a07a-2d18dc68d5f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:26.227166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ba851-b722-42ed-a07a-2d18dc68d5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8a9ba851-b722-42ed-a07a-2d18dc68d5f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:26.232340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:26.233223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:26.234073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 194/397] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:36:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:26.240362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f7e1-c461-4538-af88-2d9c27162ac1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:26.291864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:26.346932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f7e1-c461-4538-af88-2d9c27162ac1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:26.387996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8388e-1052-417f-a859-b17e487bf31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:26.388627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8388e-1052-417f-a859-b17e487bf31c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:26.388908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8388e-1052-417f-a859-b17e487bf31c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:26.389181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8388e-1052-417f-a859-b17e487bf31c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:26.389908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8388e-1052-417f-a859-b17e487bf31c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:26.390216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8388e-1052-417f-a859-b17e487bf31c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:26.392219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8388e-1052-417f-a859-b17e487bf31c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:26.401163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 204/398] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:26.406759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba851-b722-42ed-a07a-2d18dc68d5f3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:26.478047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:26.547559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba851-b722-42ed-a07a-2d18dc68d5f3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:26.587730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e1d64-c904-48b4-8ed9-bf2df11f7749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:26.588378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e1d64-c904-48b4-8ed9-bf2df11f7749 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:26.588652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e1d64-c904-48b4-8ed9-bf2df11f7749 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:26.588920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e1d64-c904-48b4-8ed9-bf2df11f7749 None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:26.590090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e1d64-c904-48b4-8ed9-bf2df11f7749 None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:26.591555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e1d64-c904-48b4-8ed9-bf2df11f7749 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:26.593446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 195/399] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:26 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:26.599307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8388e-1052-417f-a859-b17e487bf31c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:26.660067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fb708-cf9c-4dc9-8788-a2fe617f2f87 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:26.660427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fb708-cf9c-4dc9-8788-a2fe617f2f87 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:26.660593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fb708-cf9c-4dc9-8788-a2fe617f2f87 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:26.662228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 196/400] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:26.670828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c5a4c-6cc1-4099-ac4e-71d3ed08c937 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:26.671128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c5a4c-6cc1-4099-ac4e-71d3ed08c937 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:26.671401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c5a4c-6cc1-4099-ac4e-71d3ed08c937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:26.696545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-295c5a4c-6cc1-4099-ac4e-71d3ed08c937 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:26.697779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-295c5a4c-6cc1-4099-ac4e-71d3ed08c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:26.732490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8388e-1052-417f-a859-b17e487bf31c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:26.742283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:26.796372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3b70f-1392-4669-b5d9-4f518076860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:26.797069 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3b70f-1392-4669-b5d9-4f518076860c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:26.797832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3b70f-1392-4669-b5d9-4f518076860c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:26.798103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3b70f-1392-4669-b5d9-4f518076860c None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:26.800171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3b70f-1392-4669-b5d9-4f518076860c None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:26.801927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3b70f-1392-4669-b5d9-4f518076860c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:26.806408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 205/401] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:26 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:26.815602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3b70f-1392-4669-b5d9-4f518076860c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:26.821907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 197/402] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:26.867344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c5a4c-6cc1-4099-ac4e-71d3ed08c937 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:26.950171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:26.983640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3b70f-1392-4669-b5d9-4f518076860c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.018650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace1496-7b3b-458e-9239-0c199b2cd80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:27.019370 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace1496-7b3b-458e-9239-0c199b2cd80b None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.019646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace1496-7b3b-458e-9239-0c199b2cd80b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.019917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace1496-7b3b-458e-9239-0c199b2cd80b None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989/groups/a2db5c7e1da546a1a71d39b43aa37dc8/roles/d37aa78d5c9d411886137e9cdff24857` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.022106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace1496-7b3b-458e-9239-0c199b2cd80b None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc55faa34394f559d12491d3fb33989, group_id=a2db5c7e1da546a1a71d39b43aa37dc8, role_id=d37aa78d5c9d411886137e9cdff24857)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:27.022385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c5a4c-6cc1-4099-ac4e-71d3ed08c937 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.023581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace1496-7b3b-458e-9239-0c199b2cd80b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:27.042073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 206/403] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 27 07:36:26 2022] PUT /identity/v3/projects/bfc55faa34394f559d12491d3fb33989/groups/a2db5c7e1da546a1a71d39b43aa37dc8/roles/d37aa78d5c9d411886137e9cdff24857 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:36:27.043684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e914228-44fa-4f7e-a0d5-850f6d4ee25a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.044056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e914228-44fa-4f7e-a0d5-850f6d4ee25a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.044331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e914228-44fa-4f7e-a0d5-850f6d4ee25a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.045735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 207/404] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:27.060603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448e002-8569-492e-ad4d-f0416579f78d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.060913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448e002-8569-492e-ad4d-f0416579f78d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.061148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448e002-8569-492e-ad4d-f0416579f78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.087495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cfad5-9546-4a69-8c82-e02c1bb4a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:27.088173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cfad5-9546-4a69-8c82-e02c1bb4a984 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.088422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cfad5-9546-4a69-8c82-e02c1bb4a984 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.088930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cfad5-9546-4a69-8c82-e02c1bb4a984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.097785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4448e002-8569-492e-ad4d-f0416579f78d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:27.102120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4448e002-8569-492e-ad4d-f0416579f78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:27.116274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cfad5-9546-4a69-8c82-e02c1bb4a984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-059cfad5-9546-4a69-8c82-e02c1bb4a984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:27.122137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:27.123062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:27.123908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:27.125809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 198/405] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:27.135943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cfad5-9546-4a69-8c82-e02c1bb4a984 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:27.147444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:27.194209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 208/406] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 07:36:27.218756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448e002-8569-492e-ad4d-f0416579f78d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:27.309172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cfad5-9546-4a69-8c82-e02c1bb4a984 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.321709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:27.330754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448e002-8569-492e-ad4d-f0416579f78d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.347438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00b7c7-24b1-446d-a549-ec58c1cfeeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:27.348115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00b7c7-24b1-446d-a549-ec58c1cfeeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.348391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00b7c7-24b1-446d-a549-ec58c1cfeeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.348659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00b7c7-24b1-446d-a549-ec58c1cfeeb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.349437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00b7c7-24b1-446d-a549-ec58c1cfeeb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:27.349835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00b7c7-24b1-446d-a549-ec58c1cfeeb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:27.351328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00b7c7-24b1-446d-a549-ec58c1cfeeb0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:27.361420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 199/407] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:27.367035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00b7c7-24b1-446d-a549-ec58c1cfeeb0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:27.368121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37decf-94dd-45a9-9133-1cadd4a6ede6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:27.368815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37decf-94dd-45a9-9133-1cadd4a6ede6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.369093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37decf-94dd-45a9-9133-1cadd4a6ede6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.369358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37decf-94dd-45a9-9133-1cadd4a6ede6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.381172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37decf-94dd-45a9-9133-1cadd4a6ede6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2e37decf-94dd-45a9-9133-1cadd4a6ede6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:27.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:27.387118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:27.388346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 209/408] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:36:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:27.393345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37decf-94dd-45a9-9133-1cadd4a6ede6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:27.429715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:27.490913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00b7c7-24b1-446d-a549-ec58c1cfeeb0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.509185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37decf-94dd-45a9-9133-1cadd4a6ede6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.533666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18929ed5-a477-41bf-abd9-15aa7020b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:27.534721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18929ed5-a477-41bf-abd9-15aa7020b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.535190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18929ed5-a477-41bf-abd9-15aa7020b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.535660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18929ed5-a477-41bf-abd9-15aa7020b8c1 None admin] PATH_INFO: `/v3/groups/8361a35e68d4415b8525a6541aca5e73` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.537173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18929ed5-a477-41bf-abd9-15aa7020b8c1 None admin] RBAC: Authorizing `identity:get_group(group_id=8361a35e68d4415b8525a6541aca5e73)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:27.538932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18929ed5-a477-41bf-abd9-15aa7020b8c1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:27.541152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 200/409] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:27 2022] GET /identity/v3/groups/8361a35e68d4415b8525a6541aca5e73 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:27.546357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18929ed5-a477-41bf-abd9-15aa7020b8c1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:27.585122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de91e3-75ca-44f2-aa81-be9e77cf4767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:27.585753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de91e3-75ca-44f2-aa81-be9e77cf4767 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.586028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de91e3-75ca-44f2-aa81-be9e77cf4767 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.586296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de91e3-75ca-44f2-aa81-be9e77cf4767 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.587110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de91e3-75ca-44f2-aa81-be9e77cf4767 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:27.587412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de91e3-75ca-44f2-aa81-be9e77cf4767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:27.589254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de91e3-75ca-44f2-aa81-be9e77cf4767 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:27.606916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 210/410] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:27.612860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de91e3-75ca-44f2-aa81-be9e77cf4767 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:27.627253 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:27.661729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18929ed5-a477-41bf-abd9-15aa7020b8c1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.699674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6258591-2705-4f7b-88f0-6a1fa8270f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:27.700798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6258591-2705-4f7b-88f0-6a1fa8270f9c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.701325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6258591-2705-4f7b-88f0-6a1fa8270f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.701883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6258591-2705-4f7b-88f0-6a1fa8270f9c None admin] PATH_INFO: `/v3/projects/b01056c5a4f74067a3bc2250b32736cc` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.703367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6258591-2705-4f7b-88f0-6a1fa8270f9c None admin] RBAC: Authorizing `identity:get_project(project_id=b01056c5a4f74067a3bc2250b32736cc)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:27.705126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6258591-2705-4f7b-88f0-6a1fa8270f9c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:27.707536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 201/411] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:27 2022] GET /identity/v3/projects/b01056c5a4f74067a3bc2250b32736cc => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:27.712783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6258591-2705-4f7b-88f0-6a1fa8270f9c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:27.784619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de91e3-75ca-44f2-aa81-be9e77cf4767 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.803265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:27.822667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac3c32-ee33-4c56-822a-8cfb3c0ea616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:27.823735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac3c32-ee33-4c56-822a-8cfb3c0ea616 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.824228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac3c32-ee33-4c56-822a-8cfb3c0ea616 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.824698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac3c32-ee33-4c56-822a-8cfb3c0ea616 None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.831718 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac3c32-ee33-4c56-822a-8cfb3c0ea616 None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:27.833499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac3c32-ee33-4c56-822a-8cfb3c0ea616 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:27.836787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 211/412] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:27 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:27.841463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8e42f-ab8d-48ae-b295-6e967c5ab70d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.841749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8e42f-ab8d-48ae-b295-6e967c5ab70d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.842047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8e42f-ab8d-48ae-b295-6e967c5ab70d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.843616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 212/413] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:27.844512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8e42f-ab8d-48ae-b295-6e967c5ab70d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:27.921086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6258591-2705-4f7b-88f0-6a1fa8270f9c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.931729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:27.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143f38-7e2d-4d08-a4cb-2907ae4f846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:27.962259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143f38-7e2d-4d08-a4cb-2907ae4f846b None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.962778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143f38-7e2d-4d08-a4cb-2907ae4f846b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.963301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143f38-7e2d-4d08-a4cb-2907ae4f846b None admin] PATH_INFO: `/v3/projects/b01056c5a4f74067a3bc2250b32736cc/groups/8361a35e68d4415b8525a6541aca5e73/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:27.965502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143f38-7e2d-4d08-a4cb-2907ae4f846b None admin] RBAC: Authorizing `identity:create_grant(project_id=b01056c5a4f74067a3bc2250b32736cc, group_id=8361a35e68d4415b8525a6541aca5e73, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:27.967167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143f38-7e2d-4d08-a4cb-2907ae4f846b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:27.978993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8e42f-ab8d-48ae-b295-6e967c5ab70d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:27.989172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 202/414] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 27 07:36:27 2022] PUT /identity/v3/projects/b01056c5a4f74067a3bc2250b32736cc/groups/8361a35e68d4415b8525a6541aca5e73/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:27.989172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0da442-4fd3-4ed9-85aa-7156fc443db1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:27.989172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0da442-4fd3-4ed9-85aa-7156fc443db1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:27.989172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0da442-4fd3-4ed9-85aa-7156fc443db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:28.028373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9a0da442-4fd3-4ed9-85aa-7156fc443db1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:28.029612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9a0da442-4fd3-4ed9-85aa-7156fc443db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:28.069588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af637458-dff5-496c-9535-ac58c0e69ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:28.070258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af637458-dff5-496c-9535-ac58c0e69ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:28.070536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af637458-dff5-496c-9535-ac58c0e69ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:28.070810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af637458-dff5-496c-9535-ac58c0e69ea7 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:28.075229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af637458-dff5-496c-9535-ac58c0e69ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:28.076768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af637458-dff5-496c-9535-ac58c0e69ea7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:28.079362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 213/415] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:27 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:28.085998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af637458-dff5-496c-9535-ac58c0e69ea7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:28.131270 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:28.187256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 203/416] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:28.212705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0da442-4fd3-4ed9-85aa-7156fc443db1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:28.213550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af637458-dff5-496c-9535-ac58c0e69ea7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:28.259903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f662f-d649-453c-937f-c256dce7ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:28.260582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f662f-d649-453c-937f-c256dce7ecf8 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:28.260865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f662f-d649-453c-937f-c256dce7ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:28.261139 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f662f-d649-453c-937f-c256dce7ecf8 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/groups/a2db5c7e1da546a1a71d39b43aa37dc8/roles/d37aa78d5c9d411886137e9cdff24857` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:28.263991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f662f-d649-453c-937f-c256dce7ecf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebaa0703dbbd4070aa41106cffcba1fb, group_id=a2db5c7e1da546a1a71d39b43aa37dc8, role_id=d37aa78d5c9d411886137e9cdff24857)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:28.266908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f662f-d649-453c-937f-c256dce7ecf8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:28.287623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 214/417] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 27 07:36:28 2022] PUT /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb/groups/a2db5c7e1da546a1a71d39b43aa37dc8/roles/d37aa78d5c9d411886137e9cdff24857 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:28.339289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0da442-4fd3-4ed9-85aa-7156fc443db1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:28.348815 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:28.380591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda9e20-a63a-471c-988e-c3a1b2b4cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:28.381305 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda9e20-a63a-471c-988e-c3a1b2b4cc31 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:28.381590 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda9e20-a63a-471c-988e-c3a1b2b4cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:28.381862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda9e20-a63a-471c-988e-c3a1b2b4cc31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:28.394632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda9e20-a63a-471c-988e-c3a1b2b4cc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0dda9e20-a63a-471c-988e-c3a1b2b4cc31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:28.399852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:28.400840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:28.402046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 204/418] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:28.407459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f662f-d649-453c-937f-c256dce7ecf8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:28.507493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:28.531314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f662f-d649-453c-937f-c256dce7ecf8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:28.589833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95725e-2a7d-4ad5-9be1-8cbbc41cc7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:28.590462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95725e-2a7d-4ad5-9be1-8cbbc41cc7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:28.590744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95725e-2a7d-4ad5-9be1-8cbbc41cc7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:28.591038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95725e-2a7d-4ad5-9be1-8cbbc41cc7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:28.591767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95725e-2a7d-4ad5-9be1-8cbbc41cc7d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:28.592071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95725e-2a7d-4ad5-9be1-8cbbc41cc7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:28.593449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95725e-2a7d-4ad5-9be1-8cbbc41cc7d5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:28.604830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 215/419] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:28.610709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda9e20-a63a-471c-988e-c3a1b2b4cc31 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:28.668809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be33d9b-ae87-4aa4-9b7a-a549a322ecb4 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:28.669148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be33d9b-ae87-4aa4-9b7a-a549a322ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:28.669428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be33d9b-ae87-4aa4-9b7a-a549a322ecb4 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:28.670867 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 216/420] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:28.676935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94329f-a2ff-4385-b8c5-6b2501c109fd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:28.677214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94329f-a2ff-4385-b8c5-6b2501c109fd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:28.677517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94329f-a2ff-4385-b8c5-6b2501c109fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:28.700064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4e94329f-a2ff-4385-b8c5-6b2501c109fd None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:28.702428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4e94329f-a2ff-4385-b8c5-6b2501c109fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:28.735632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda9e20-a63a-471c-988e-c3a1b2b4cc31 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:28.782718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b43025-a450-47a5-bc88-6196083386ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:28.784643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b43025-a450-47a5-bc88-6196083386ab None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:28.784922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b43025-a450-47a5-bc88-6196083386ab None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:28.785195 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b43025-a450-47a5-bc88-6196083386ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:28.827147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 217/421] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:28.841524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:28.862390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94329f-a2ff-4385-b8c5-6b2501c109fd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:28.899435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b43025-a450-47a5-bc88-6196083386ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:28.901245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b43025-a450-47a5-bc88-6196083386ab None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:28.947762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:28.977683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94329f-a2ff-4385-b8c5-6b2501c109fd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:29.016505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63940c-6bec-44ce-bdc0-0055bf48f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:29.017439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63940c-6bec-44ce-bdc0-0055bf48f28f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:29.017724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63940c-6bec-44ce-bdc0-0055bf48f28f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:29.017993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63940c-6bec-44ce-bdc0-0055bf48f28f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:29.029864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63940c-6bec-44ce-bdc0-0055bf48f28f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ec63940c-6bec-44ce-bdc0-0055bf48f28f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:29.036317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:29.037209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:29.038171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 218/422] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:29.043750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63940c-6bec-44ce-bdc0-0055bf48f28f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:29.129322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 205/423] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 07:36:29.135047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b43025-a450-47a5-bc88-6196083386ab None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:29.159890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63940c-6bec-44ce-bdc0-0055bf48f28f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:29.200204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8e642-c278-44fd-b1a6-1fafa46d2d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:29.201210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e642-c278-44fd-b1a6-1fafa46d2d8a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:29.201580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e642-c278-44fd-b1a6-1fafa46d2d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:29.201945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e642-c278-44fd-b1a6-1fafa46d2d8a None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:29.203251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8e642-c278-44fd-b1a6-1fafa46d2d8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:29.204163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8e642-c278-44fd-b1a6-1fafa46d2d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:29.205791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8e642-c278-44fd-b1a6-1fafa46d2d8a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:29.207575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:29.217703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 219/424] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:36:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:29.223881 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8e642-c278-44fd-b1a6-1fafa46d2d8a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:29.256902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:29.345823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b43025-a450-47a5-bc88-6196083386ab None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:29.392159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8e642-c278-44fd-b1a6-1fafa46d2d8a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:29.412867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585997e4-d588-40b8-b81b-fe3dc630dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:29.413759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585997e4-d588-40b8-b81b-fe3dc630dd37 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:29.414187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585997e4-d588-40b8-b81b-fe3dc630dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:29.414605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585997e4-d588-40b8-b81b-fe3dc630dd37 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:29.416684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585997e4-d588-40b8-b81b-fe3dc630dd37 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:29.418396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585997e4-d588-40b8-b81b-fe3dc630dd37 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:29.424787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 206/425] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:29 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:29.425979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585997e4-d588-40b8-b81b-fe3dc630dd37 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:29.427375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0897a-16fd-4435-be7f-871bf875960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:29.434917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0897a-16fd-4435-be7f-871bf875960f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:29.434917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0897a-16fd-4435-be7f-871bf875960f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:29.434917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0897a-16fd-4435-be7f-871bf875960f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:29.496634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:29.504383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0897a-16fd-4435-be7f-871bf875960f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:29.505986 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0897a-16fd-4435-be7f-871bf875960f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:29.582625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585997e4-d588-40b8-b81b-fe3dc630dd37 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:29.612647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:29.613246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 220/426] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:29.618729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0897a-16fd-4435-be7f-871bf875960f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:29.639319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc302b-7f7a-4ea5-a14e-68a5dc8d768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:29.639986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc302b-7f7a-4ea5-a14e-68a5dc8d768a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:29.640271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc302b-7f7a-4ea5-a14e-68a5dc8d768a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:29.640552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc302b-7f7a-4ea5-a14e-68a5dc8d768a None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:29.647671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc302b-7f7a-4ea5-a14e-68a5dc8d768a None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:29.649139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc302b-7f7a-4ea5-a14e-68a5dc8d768a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:29.655791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 207/427] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:29 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:29.657228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc302b-7f7a-4ea5-a14e-68a5dc8d768a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:29.739571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0897a-16fd-4435-be7f-871bf875960f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:29.743287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:29.787091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fcbf7-b9c5-4db7-9a48-a9b76c55d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:29.788219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fcbf7-b9c5-4db7-9a48-a9b76c55d5ad None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:29.789352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fcbf7-b9c5-4db7-9a48-a9b76c55d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:29.789987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fcbf7-b9c5-4db7-9a48-a9b76c55d5ad None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:29.792033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fcbf7-b9c5-4db7-9a48-a9b76c55d5ad None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:29.794049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fcbf7-b9c5-4db7-9a48-a9b76c55d5ad None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:29.796356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 221/428] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:29 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:29.796483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc302b-7f7a-4ea5-a14e-68a5dc8d768a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:29.797689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5196d-9b2b-4284-bbe8-0ce01e42ca06 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:29.797967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5196d-9b2b-4284-bbe8-0ce01e42ca06 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:29.798427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5196d-9b2b-4284-bbe8-0ce01e42ca06 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:29.800891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 222/429] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:29.802461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5196d-9b2b-4284-bbe8-0ce01e42ca06 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:29.844523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c319e29-8be5-4ce4-83ff-391e2a909a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:29.845570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c319e29-8be5-4ce4-83ff-391e2a909a23 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:29.845929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c319e29-8be5-4ce4-83ff-391e2a909a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:29.846737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c319e29-8be5-4ce4-83ff-391e2a909a23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:29.847828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c319e29-8be5-4ce4-83ff-391e2a909a23 None admin] RBAC: Adding query filter params (group.id=a2db5c7e1da546a1a71d39b43aa37dc8, role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=bfc55faa34394f559d12491d3fb33989) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:29.848147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c319e29-8be5-4ce4-83ff-391e2a909a23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:29.850378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c319e29-8be5-4ce4-83ff-391e2a909a23 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:29.857912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 208/430] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:29 2022] GET /identity/v3/role_assignments?group.id=a2db5c7e1da546a1a71d39b43aa37dc8&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:29.859107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2a22-2378-4962-8ac6-85b68cb9ca6a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:29.859396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2a22-2378-4962-8ac6-85b68cb9ca6a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:29.859732 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f2a22-2378-4962-8ac6-85b68cb9ca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:29.904094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7e9f2a22-2378-4962-8ac6-85b68cb9ca6a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:29.905249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7e9f2a22-2378-4962-8ac6-85b68cb9ca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:29.984468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5196d-9b2b-4284-bbe8-0ce01e42ca06 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:30.039290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:30.050109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab39c92-d874-4b78-b185-5ae4441df192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:30.050863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39c92-d874-4b78-b185-5ae4441df192 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.051170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39c92-d874-4b78-b185-5ae4441df192 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.051450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39c92-d874-4b78-b185-5ae4441df192 None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.051616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 209/431] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:30.052940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab39c92-d874-4b78-b185-5ae4441df192 None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:30.054551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab39c92-d874-4b78-b185-5ae4441df192 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:30.056369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 223/432] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:29 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:30.061966 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f2a22-2378-4962-8ac6-85b68cb9ca6a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:30.079207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab39c92-d874-4b78-b185-5ae4441df192 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:30.128549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:30.189683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f2a22-2378-4962-8ac6-85b68cb9ca6a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:30.217222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab39c92-d874-4b78-b185-5ae4441df192 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:30.238174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1bf9-357e-45f5-bcd4-be973decd8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:30.238807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1bf9-357e-45f5-bcd4-be973decd8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.239158 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1bf9-357e-45f5-bcd4-be973decd8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.239432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1bf9-357e-45f5-bcd4-be973decd8e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.240337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca1bf9-357e-45f5-bcd4-be973decd8e2 None admin] RBAC: Adding query filter params (group.id=a2db5c7e1da546a1a71d39b43aa37dc8, role.id=a53dca7201f54f8b841a25178a7e91a6, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:30.240554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca1bf9-357e-45f5-bcd4-be973decd8e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:30.242006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca1bf9-357e-45f5-bcd4-be973decd8e2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:30.249415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 210/433] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:30 2022] GET /identity/v3/role_assignments?group.id=a2db5c7e1da546a1a71d39b43aa37dc8&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=a53dca7201f54f8b841a25178a7e91a6 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:30.262457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be615ede-7c98-474d-85d0-244a578c8fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:30.263495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be615ede-7c98-474d-85d0-244a578c8fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.263951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be615ede-7c98-474d-85d0-244a578c8fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.264394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be615ede-7c98-474d-85d0-244a578c8fe2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.277615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be615ede-7c98-474d-85d0-244a578c8fe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-be615ede-7c98-474d-85d0-244a578c8fe2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:30.283762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:30.284723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:30.285517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:30.288395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 224/434] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:36:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:30.294444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1bf9-357e-45f5-bcd4-be973decd8e2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:30.360490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:30.417555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1bf9-357e-45f5-bcd4-be973decd8e2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:30.456131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2a14b-51cb-40ea-9ac2-d8e499fcc1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:30.456689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a14b-51cb-40ea-9ac2-d8e499fcc1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.456973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a14b-51cb-40ea-9ac2-d8e499fcc1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.457247 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a14b-51cb-40ea-9ac2-d8e499fcc1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.457981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2a14b-51cb-40ea-9ac2-d8e499fcc1a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:30.458287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2a14b-51cb-40ea-9ac2-d8e499fcc1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:30.459718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2a14b-51cb-40ea-9ac2-d8e499fcc1a1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:30.474063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 211/435] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:30.475436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be615ede-7c98-474d-85d0-244a578c8fe2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:30.582949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:30.592348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be615ede-7c98-474d-85d0-244a578c8fe2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:30.630764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09d33f-b203-4c3c-8fc8-bb741b8f2b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:30.631143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce316025-b26b-4cfa-a5a1-a4bdb151d86f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.631561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce316025-b26b-4cfa-a5a1-a4bdb151d86f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.631646 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce316025-b26b-4cfa-a5a1-a4bdb151d86f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.632416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09d33f-b203-4c3c-8fc8-bb741b8f2b09 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.632696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09d33f-b203-4c3c-8fc8-bb741b8f2b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.632961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09d33f-b203-4c3c-8fc8-bb741b8f2b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.635071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 212/436] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:30.640003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c44b9-82f2-4543-a548-2e3f4da8b71d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.640559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c44b9-82f2-4543-a548-2e3f4da8b71d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.641087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c44b9-82f2-4543-a548-2e3f4da8b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.678644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-832c44b9-82f2-4543-a548-2e3f4da8b71d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:30.680221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-832c44b9-82f2-4543-a548-2e3f4da8b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:30.715133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09d33f-b203-4c3c-8fc8-bb741b8f2b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:30.716919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09d33f-b203-4c3c-8fc8-bb741b8f2b09 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:30.757044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 213/437] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:30.758648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8174c-d405-4c5d-9eae-50ae94f075c9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.758867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8174c-d405-4c5d-9eae-50ae94f075c9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.759166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8174c-d405-4c5d-9eae-50ae94f075c9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.760400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 214/438] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:30.766223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a550680-63a4-4cd8-974e-abba4e2961b7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.766653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a550680-63a4-4cd8-974e-abba4e2961b7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.767233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a550680-63a4-4cd8-974e-abba4e2961b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.789425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1a550680-63a4-4cd8-974e-abba4e2961b7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:30.790651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1a550680-63a4-4cd8-974e-abba4e2961b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:30.817378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:30.827427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 225/439] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:30.828298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09d33f-b203-4c3c-8fc8-bb741b8f2b09 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:30.840506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:30.868855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 215/440] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:30.869954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a550680-63a4-4cd8-974e-abba4e2961b7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:30.940503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09d33f-b203-4c3c-8fc8-bb741b8f2b09 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:30.972582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a550680-63a4-4cd8-974e-abba4e2961b7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:30.974874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fbec4-e1fb-40a0-89af-bccc1d073de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:30.975535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fbec4-e1fb-40a0-89af-bccc1d073de3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:30.975810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fbec4-e1fb-40a0-89af-bccc1d073de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:30.976078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fbec4-e1fb-40a0-89af-bccc1d073de3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:30.986282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fbec4-e1fb-40a0-89af-bccc1d073de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-486fbec4-e1fb-40a0-89af-bccc1d073de3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:30.991293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:30.992365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 226/441] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:30.993347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fbec4-e1fb-40a0-89af-bccc1d073de3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.008308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04837b8b-7f0e-4f56-82cf-c31b6a35ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.008958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04837b8b-7f0e-4f56-82cf-c31b6a35ab87 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.009239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04837b8b-7f0e-4f56-82cf-c31b6a35ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.009807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04837b8b-7f0e-4f56-82cf-c31b6a35ab87 None admin] PATH_INFO: `/v3/projects/bfc55faa34394f559d12491d3fb33989` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:31.010679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04837b8b-7f0e-4f56-82cf-c31b6a35ab87 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc55faa34394f559d12491d3fb33989)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:31.012171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04837b8b-7f0e-4f56-82cf-c31b6a35ab87 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:31.014102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 216/442] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:30 2022] GET /identity/v3/projects/bfc55faa34394f559d12491d3fb33989 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:31.014585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04837b8b-7f0e-4f56-82cf-c31b6a35ab87 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.046575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:31.058993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:31.095243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fbec4-e1fb-40a0-89af-bccc1d073de3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.117402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04837b8b-7f0e-4f56-82cf-c31b6a35ab87 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.128921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984a980-ecc7-420c-ad80-e33771e88431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.129568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984a980-ecc7-420c-ad80-e33771e88431 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.129846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984a980-ecc7-420c-ad80-e33771e88431 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.130118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984a980-ecc7-420c-ad80-e33771e88431 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:31.141244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984a980-ecc7-420c-ad80-e33771e88431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b984a980-ecc7-420c-ad80-e33771e88431 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:31.146196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:31.147282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:31.148120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 227/443] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:36:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:31.148776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984a980-ecc7-420c-ad80-e33771e88431 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.157139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36033932-58ce-4cf4-bb53-988b439f17b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.157782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36033932-58ce-4cf4-bb53-988b439f17b1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.158062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36033932-58ce-4cf4-bb53-988b439f17b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.158341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36033932-58ce-4cf4-bb53-988b439f17b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:31.159126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36033932-58ce-4cf4-bb53-988b439f17b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:31.159432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36033932-58ce-4cf4-bb53-988b439f17b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:31.160840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36033932-58ce-4cf4-bb53-988b439f17b1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:31.175660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 217/444] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:31.176537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36033932-58ce-4cf4-bb53-988b439f17b1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.256520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984a980-ecc7-420c-ad80-e33771e88431 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.270022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:31.276011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36033932-58ce-4cf4-bb53-988b439f17b1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.278275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:31.291444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f2b7b-8c49-4026-a1fe-2b390468a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.292079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f2b7b-8c49-4026-a1fe-2b390468a038 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.292360 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f2b7b-8c49-4026-a1fe-2b390468a038 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.292632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f2b7b-8c49-4026-a1fe-2b390468a038 None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:31.293800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f2b7b-8c49-4026-a1fe-2b390468a038 None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:31.295276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f2b7b-8c49-4026-a1fe-2b390468a038 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:31.297436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 228/445] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:31 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:31.298227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f2b7b-8c49-4026-a1fe-2b390468a038 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.312082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162973e5-acc4-42de-8103-dcf1192bb9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.313252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162973e5-acc4-42de-8103-dcf1192bb9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.313526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162973e5-acc4-42de-8103-dcf1192bb9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.313794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162973e5-acc4-42de-8103-dcf1192bb9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:31.314515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162973e5-acc4-42de-8103-dcf1192bb9d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:31.314811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162973e5-acc4-42de-8103-dcf1192bb9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:31.316198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162973e5-acc4-42de-8103-dcf1192bb9d3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:31.324075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 218/446] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:31.324852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162973e5-acc4-42de-8103-dcf1192bb9d3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.397705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f2b7b-8c49-4026-a1fe-2b390468a038 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.429834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162973e5-acc4-42de-8103-dcf1192bb9d3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.431756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb6e82-960c-4fac-a240-7825b8637286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.433165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb6e82-960c-4fac-a240-7825b8637286 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.433443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb6e82-960c-4fac-a240-7825b8637286 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.433720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb6e82-960c-4fac-a240-7825b8637286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:31.465232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a41ca-d636-4f79-9688-6cfdf7eb7a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.465862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a41ca-d636-4f79-9688-6cfdf7eb7a5a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.466143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a41ca-d636-4f79-9688-6cfdf7eb7a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.466415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a41ca-d636-4f79-9688-6cfdf7eb7a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:31.467262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a41ca-d636-4f79-9688-6cfdf7eb7a5a None admin] RBAC: Adding query filter params (group.id=a2db5c7e1da546a1a71d39b43aa37dc8, role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=bfc55faa34394f559d12491d3fb33989) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:31.467575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a41ca-d636-4f79-9688-6cfdf7eb7a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:31.469517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a41ca-d636-4f79-9688-6cfdf7eb7a5a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:31.475959 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 219/447] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:31 2022] GET /identity/v3/role_assignments?group.id=a2db5c7e1da546a1a71d39b43aa37dc8&scope.project.id=bfc55faa34394f559d12491d3fb33989&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:31.476570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a41ca-d636-4f79-9688-6cfdf7eb7a5a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.489776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:31.518811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb6e82-960c-4fac-a240-7825b8637286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:31.520256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb6e82-960c-4fac-a240-7825b8637286 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:31.524659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:31.609300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a41ca-d636-4f79-9688-6cfdf7eb7a5a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.651675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aec3e1-4c88-4ef2-8361-f3ec55615ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.652331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aec3e1-4c88-4ef2-8361-f3ec55615ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.652574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aec3e1-4c88-4ef2-8361-f3ec55615ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.652841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aec3e1-4c88-4ef2-8361-f3ec55615ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:31.657312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 229/448] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:31.663492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb6e82-960c-4fac-a240-7825b8637286 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.740656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aec3e1-4c88-4ef2-8361-f3ec55615ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:31.742180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aec3e1-4c88-4ef2-8361-f3ec55615ac7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:31.753195 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:31.775929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:31.779027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb6e82-960c-4fac-a240-7825b8637286 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.825516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0de23-b0cb-4bfb-94f8-6a79dc464e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.826453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0de23-b0cb-4bfb-94f8-6a79dc464e74 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.826927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0de23-b0cb-4bfb-94f8-6a79dc464e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.827395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0de23-b0cb-4bfb-94f8-6a79dc464e74 None admin] PATH_INFO: `/v3/projects/b01056c5a4f74067a3bc2250b32736cc` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:31.830531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0de23-b0cb-4bfb-94f8-6a79dc464e74 None admin] RBAC: Authorizing `identity:get_project(project_id=b01056c5a4f74067a3bc2250b32736cc)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:31.833258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0de23-b0cb-4bfb-94f8-6a79dc464e74 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:31.838055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 230/449] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:31 2022] GET /identity/v3/projects/b01056c5a4f74067a3bc2250b32736cc => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:31.839457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0de23-b0cb-4bfb-94f8-6a79dc464e74 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.875850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 220/450] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:31.879423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aec3e1-4c88-4ef2-8361-f3ec55615ac7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:31.955744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0de23-b0cb-4bfb-94f8-6a79dc464e74 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.989206 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aec3e1-4c88-4ef2-8361-f3ec55615ac7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:31.998642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b1cad-3015-4575-9898-90c06aee5a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:31.999311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b1cad-3015-4575-9898-90c06aee5a9e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:31.999588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b1cad-3015-4575-9898-90c06aee5a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:31.999854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b1cad-3015-4575-9898-90c06aee5a9e None admin] PATH_INFO: `/v3/groups/8361a35e68d4415b8525a6541aca5e73` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:32.001668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b1cad-3015-4575-9898-90c06aee5a9e None admin] RBAC: Authorizing `identity:get_group(group_id=8361a35e68d4415b8525a6541aca5e73)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:32.003204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b1cad-3015-4575-9898-90c06aee5a9e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:32.004975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 231/451] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:31 2022] GET /identity/v3/groups/8361a35e68d4415b8525a6541aca5e73 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:32.010871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b1cad-3015-4575-9898-90c06aee5a9e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:32.024728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:32.029674 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:32.031099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ba38-61f3-4f37-b53a-1df9a5f0e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:32.031816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ba38-61f3-4f37-b53a-1df9a5f0e953 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:32.032094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ba38-61f3-4f37-b53a-1df9a5f0e953 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:32.032367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ba38-61f3-4f37-b53a-1df9a5f0e953 None admin] PATH_INFO: `/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:32.033554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244ba38-61f3-4f37-b53a-1df9a5f0e953 None admin] RBAC: Authorizing `identity:get_project(project_id=ebaa0703dbbd4070aa41106cffcba1fb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:32.035034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244ba38-61f3-4f37-b53a-1df9a5f0e953 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:32.036695 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 221/452] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:36:31 2022] GET /identity/v3/projects/ebaa0703dbbd4070aa41106cffcba1fb => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:32.042070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ba38-61f3-4f37-b53a-1df9a5f0e953 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:32.117587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b1cad-3015-4575-9898-90c06aee5a9e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:32.144596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ba38-61f3-4f37-b53a-1df9a5f0e953 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:32.152925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fede2-d6a7-45db-b554-a5fb27dc6d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:32.153539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fede2-d6a7-45db-b554-a5fb27dc6d80 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:32.153823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fede2-d6a7-45db-b554-a5fb27dc6d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:32.154095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fede2-d6a7-45db-b554-a5fb27dc6d80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:32.154921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fede2-d6a7-45db-b554-a5fb27dc6d80 None admin] RBAC: Adding query filter params (group.id=8361a35e68d4415b8525a6541aca5e73, role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=b01056c5a4f74067a3bc2250b32736cc) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:32.155222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fede2-d6a7-45db-b554-a5fb27dc6d80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:32.156721 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fede2-d6a7-45db-b554-a5fb27dc6d80 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:32.162407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 232/453] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:32 2022] GET /identity/v3/role_assignments?group.id=8361a35e68d4415b8525a6541aca5e73&scope.project.id=b01056c5a4f74067a3bc2250b32736cc&role.id=2ba3b2926541436a9d26782420538af3 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:32.178421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e10446-96ae-42f0-9207-aa3bba31b34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:32.179130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10446-96ae-42f0-9207-aa3bba31b34e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:32.179413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10446-96ae-42f0-9207-aa3bba31b34e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:32.179687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10446-96ae-42f0-9207-aa3bba31b34e None admin] PATH_INFO: `/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:32.180947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e10446-96ae-42f0-9207-aa3bba31b34e None admin] RBAC: Authorizing `identity:get_group(group_id=a2db5c7e1da546a1a71d39b43aa37dc8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:32.182425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e10446-96ae-42f0-9207-aa3bba31b34e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:32.184150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 222/454] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 27 07:36:32 2022] GET /identity/v3/groups/a2db5c7e1da546a1a71d39b43aa37dc8 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:32.191100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fede2-d6a7-45db-b554-a5fb27dc6d80 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:32.278251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:32.298066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fede2-d6a7-45db-b554-a5fb27dc6d80 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:32.334563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192dd9e-c787-4898-a995-39910f1c3d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:32.335207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192dd9e-c787-4898-a995-39910f1c3d67 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:32.335487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192dd9e-c787-4898-a995-39910f1c3d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:32.335761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192dd9e-c787-4898-a995-39910f1c3d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:32.337294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192dd9e-c787-4898-a995-39910f1c3d67 None admin] RBAC: Adding query filter params (group.id=a2db5c7e1da546a1a71d39b43aa37dc8, role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:32.337294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192dd9e-c787-4898-a995-39910f1c3d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:32.338388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192dd9e-c787-4898-a995-39910f1c3d67 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:32.344422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 233/455] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 27 07:36:32 2022] GET /identity/v3/role_assignments?group.id=a2db5c7e1da546a1a71d39b43aa37dc8&scope.project.id=ebaa0703dbbd4070aa41106cffcba1fb&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:34.857570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d448c-0c74-4e70-a1b9-6e4920afdcaf None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:34.858598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d448c-0c74-4e70-a1b9-6e4920afdcaf None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:34.859093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d448c-0c74-4e70-a1b9-6e4920afdcaf None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:34.861138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 223/456] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:34.866364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9c528-231c-4cd5-8cf1-c318985db14a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:34.867225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9c528-231c-4cd5-8cf1-c318985db14a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:34.867691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9c528-231c-4cd5-8cf1-c318985db14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:34.892508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-47e9c528-231c-4cd5-8cf1-c318985db14a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:34.894251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-47e9c528-231c-4cd5-8cf1-c318985db14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:34.998085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 234/457] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:35.034867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d448c-0c74-4e70-a1b9-6e4920afdcaf None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:35.095925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e229013-fc0d-4e83-bcc5-26187aa4dd87 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.096818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e229013-fc0d-4e83-bcc5-26187aa4dd87 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.097390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e229013-fc0d-4e83-bcc5-26187aa4dd87 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.099319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 235/458] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:35.105152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688d708-b1b1-4483-8f77-ce8ed05de533 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.105694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688d708-b1b1-4483-8f77-ce8ed05de533 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.106195 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688d708-b1b1-4483-8f77-ce8ed05de533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.151349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:35.152254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d688d708-b1b1-4483-8f77-ce8ed05de533 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:35.153507 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d688d708-b1b1-4483-8f77-ce8ed05de533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:35.174707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d448c-0c74-4e70-a1b9-6e4920afdcaf None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:35.211379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd956ddc-46c4-4c8c-939a-9a522a2765c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:35.212259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd956ddc-46c4-4c8c-939a-9a522a2765c0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.212682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd956ddc-46c4-4c8c-939a-9a522a2765c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.213127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd956ddc-46c4-4c8c-939a-9a522a2765c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.225030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd956ddc-46c4-4c8c-939a-9a522a2765c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:35.226838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd956ddc-46c4-4c8c-939a-9a522a2765c0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:35.228932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 236/459] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 07:36:35.230760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd002-f7af-4ed3-951a-0f67bb691798 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.231179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd002-f7af-4ed3-951a-0f67bb691798 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.231529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd002-f7af-4ed3-951a-0f67bb691798 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.233115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 237/460] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:35.244250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fd473-f3cb-4655-825a-d56f6be6d4d8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.244534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fd473-f3cb-4655-825a-d56f6be6d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.244813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fd473-f3cb-4655-825a-d56f6be6d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-dd956ddc-46c4-4c8c-939a-9a522a2765c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:35.248847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:35.249674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:35.250643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:35.250643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:35.250643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:35.250643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:35.253098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 224/461] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:35.258392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd956ddc-46c4-4c8c-939a-9a522a2765c0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:35.262673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:35.274646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-334fd473-f3cb-4655-825a-d56f6be6d4d8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:35.275898 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-334fd473-f3cb-4655-825a-d56f6be6d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:35.347538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 238/462] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:35.348502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fd473-f3cb-4655-825a-d56f6be6d4d8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:35.390677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd956ddc-46c4-4c8c-939a-9a522a2765c0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:35.418502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:35.444505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb23c-a5c9-4d55-896c-236a864e2433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:35.445452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb23c-a5c9-4d55-896c-236a864e2433 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.446306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb23c-a5c9-4d55-896c-236a864e2433 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.446795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb23c-a5c9-4d55-896c-236a864e2433 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.447722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb23c-a5c9-4d55-896c-236a864e2433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:35.448224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb23c-a5c9-4d55-896c-236a864e2433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:35.449788 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb23c-a5c9-4d55-896c-236a864e2433 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:35.460747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fd473-f3cb-4655-825a-d56f6be6d4d8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:35.463814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 225/463] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:35.464931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb23c-a5c9-4d55-896c-236a864e2433 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:35.498683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae835b4-c754-4627-b8af-f6fcaa6bef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:35.499321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae835b4-c754-4627-b8af-f6fcaa6bef5b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.499606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae835b4-c754-4627-b8af-f6fcaa6bef5b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.499928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae835b4-c754-4627-b8af-f6fcaa6bef5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.503495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:35.516821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae835b4-c754-4627-b8af-f6fcaa6bef5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:35.518631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae835b4-c754-4627-b8af-f6fcaa6bef5b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7ae835b4-c754-4627-b8af-f6fcaa6bef5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:35.540307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:35.541227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:35.542508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:35.542508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:35.542508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:35.542508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:35.542508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 239/464] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:35.542769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae835b4-c754-4627-b8af-f6fcaa6bef5b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:35.582530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb23c-a5c9-4d55-896c-236a864e2433 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:35.621088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05618c3-b1a1-46b0-bc0a-dd92e3b06d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:35.621738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05618c3-b1a1-46b0-bc0a-dd92e3b06d6f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.622016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05618c3-b1a1-46b0-bc0a-dd92e3b06d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.622284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05618c3-b1a1-46b0-bc0a-dd92e3b06d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.633767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05618c3-b1a1-46b0-bc0a-dd92e3b06d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:35.635271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05618c3-b1a1-46b0-bc0a-dd92e3b06d6f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a05618c3-b1a1-46b0-bc0a-dd92e3b06d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:35.652220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:35.653109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:35.653946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:35.653946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:35.653946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:35.653946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:35.658604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 226/465] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:35.659649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05618c3-b1a1-46b0-bc0a-dd92e3b06d6f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:35.665316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae835b4-c754-4627-b8af-f6fcaa6bef5b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:35.693394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:35.704184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31afa7-582d-4292-86ae-4872e1bd149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:35.705028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31afa7-582d-4292-86ae-4872e1bd149b None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.705295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31afa7-582d-4292-86ae-4872e1bd149b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.705562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31afa7-582d-4292-86ae-4872e1bd149b None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.706256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31afa7-582d-4292-86ae-4872e1bd149b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:35.707943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31afa7-582d-4292-86ae-4872e1bd149b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:35.733479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 240/466] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:36:35 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:36:35.734490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31afa7-582d-4292-86ae-4872e1bd149b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:35.787955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:35.839961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05618c3-b1a1-46b0-bc0a-dd92e3b06d6f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:35.854502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31afa7-582d-4292-86ae-4872e1bd149b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:35.893733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414905a-8f84-4572-a643-592baf3bd1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:35.894668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414905a-8f84-4572-a643-592baf3bd1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.895120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414905a-8f84-4572-a643-592baf3bd1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.895559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414905a-8f84-4572-a643-592baf3bd1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.896492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414905a-8f84-4572-a643-592baf3bd1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:35.896906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414905a-8f84-4572-a643-592baf3bd1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:35.898442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414905a-8f84-4572-a643-592baf3bd1c7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:35.912296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 241/467] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:35.923993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414905a-8f84-4572-a643-592baf3bd1c7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:35.926318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787423d5-a198-4e9f-b2e2-3daf50fb34ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:35.927063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787423d5-a198-4e9f-b2e2-3daf50fb34ca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:35.927411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787423d5-a198-4e9f-b2e2-3daf50fb34ca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:35.927753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787423d5-a198-4e9f-b2e2-3daf50fb34ca None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:35.928530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787423d5-a198-4e9f-b2e2-3daf50fb34ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:35.928901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787423d5-a198-4e9f-b2e2-3daf50fb34ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:35.930360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787423d5-a198-4e9f-b2e2-3daf50fb34ca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:35.944363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 227/468] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:35.950018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787423d5-a198-4e9f-b2e2-3daf50fb34ca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:36.067572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:36.076265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414905a-8f84-4572-a643-592baf3bd1c7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:36.078196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:36.080903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787423d5-a198-4e9f-b2e2-3daf50fb34ca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:36.127549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8189a65-40ad-4ba1-978f-43b32dbb1fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:36.128170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8189a65-40ad-4ba1-978f-43b32dbb1fa8 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:36.128450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8189a65-40ad-4ba1-978f-43b32dbb1fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:36.128724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8189a65-40ad-4ba1-978f-43b32dbb1fa8 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:36.129415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8189a65-40ad-4ba1-978f-43b32dbb1fa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:36.130879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8189a65-40ad-4ba1-978f-43b32dbb1fa8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:36.132848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092f931-1589-45b6-81bc-8df9fa699b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:36.133585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092f931-1589-45b6-81bc-8df9fa699b1f None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:36.133870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092f931-1589-45b6-81bc-8df9fa699b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:36.134147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092f931-1589-45b6-81bc-8df9fa699b1f None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:36.134847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092f931-1589-45b6-81bc-8df9fa699b1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:36.136315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092f931-1589-45b6-81bc-8df9fa699b1f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:36.161111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 242/469] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:36:35 2022] POST /identity/v3/users => generated 248 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:36:36.161761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 228/470] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:36:35 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:36:36.162400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ba74b-011b-4c15-b8bb-1de2ec1f18d5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:36.162696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ba74b-011b-4c15-b8bb-1de2ec1f18d5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:36.162998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ba74b-011b-4c15-b8bb-1de2ec1f18d5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:36.164518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 243/471] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:36.173663 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4d9c-6a6a-4684-bd7a-b0216a4fcad6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:36.174013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4d9c-6a6a-4684-bd7a-b0216a4fcad6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:36.174227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4d9c-6a6a-4684-bd7a-b0216a4fcad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:36.201551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-724f4d9c-6a6a-4684-bd7a-b0216a4fcad6 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:36.203058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-724f4d9c-6a6a-4684-bd7a-b0216a4fcad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:36.302050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 229/472] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:36.347473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ba74b-011b-4c15-b8bb-1de2ec1f18d5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:36.486818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ba74b-011b-4c15-b8bb-1de2ec1f18d5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:36.528930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59780cae-08f5-427d-b17e-43ea5aa117bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:36.529832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59780cae-08f5-427d-b17e-43ea5aa117bf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:36.530113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59780cae-08f5-427d-b17e-43ea5aa117bf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:36.530386 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59780cae-08f5-427d-b17e-43ea5aa117bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:36.547024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59780cae-08f5-427d-b17e-43ea5aa117bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:36.548502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59780cae-08f5-427d-b17e-43ea5aa117bf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-59780cae-08f5-427d-b17e-43ea5aa117bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:36.564396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:36.565301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:36.566228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:36.566228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:36.566228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:36.566228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:36.566228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 244/473] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:36.572874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f4d9c-6a6a-4684-bd7a-b0216a4fcad6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:36.593623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6db37-002b-41ba-9d16-b9eb4dc17424 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:36.594292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6db37-002b-41ba-9d16-b9eb4dc17424 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:36.594551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6db37-002b-41ba-9d16-b9eb4dc17424 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:36.596261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 245/474] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:36.601746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463796a-88a7-422a-9174-093ce1a4ae27 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:36.602126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463796a-88a7-422a-9174-093ce1a4ae27 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:36.602412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463796a-88a7-422a-9174-093ce1a4ae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:36.621930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e463796a-88a7-422a-9174-093ce1a4ae27 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:36.623185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e463796a-88a7-422a-9174-093ce1a4ae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:36.635263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:36.661309 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:36.706654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f4d9c-6a6a-4684-bd7a-b0216a4fcad6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:36.757795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e0396-15ef-43a8-b392-dd7883c2c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:36.758745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e0396-15ef-43a8-b392-dd7883c2c20a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:36.759224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e0396-15ef-43a8-b392-dd7883c2c20a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:36.759673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e0396-15ef-43a8-b392-dd7883c2c20a None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:36.761519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e0396-15ef-43a8-b392-dd7883c2c20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:36.762007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e0396-15ef-43a8-b392-dd7883c2c20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:36.762321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 246/475] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:36.763945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e0396-15ef-43a8-b392-dd7883c2c20a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:36.777823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 230/476] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:36.783558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463796a-88a7-422a-9174-093ce1a4ae27 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:36.815764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e0396-15ef-43a8-b392-dd7883c2c20a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:36.961789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463796a-88a7-422a-9174-093ce1a4ae27 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:36.962796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e0396-15ef-43a8-b392-dd7883c2c20a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:37.016915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fded5-c2ae-490f-aad0-e2d1f9cd62de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:37.017521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fded5-c2ae-490f-aad0-e2d1f9cd62de None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:37.017802 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fded5-c2ae-490f-aad0-e2d1f9cd62de None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:37.018073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fded5-c2ae-490f-aad0-e2d1f9cd62de None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:37.018820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fded5-c2ae-490f-aad0-e2d1f9cd62de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:37.020291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fded5-c2ae-490f-aad0-e2d1f9cd62de None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:37.028514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:37.029151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:37.029433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:37.029707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:37.030447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:37.031781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:37.031935 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:37.037992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:37.044362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.sql.core [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 07:36:37.044362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 07:36:37.044362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [parameters: {'id': '8938708d57e441c0a6316d3d71571b2a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 07:36:37.044362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80295) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 07:36:37.054381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 247/477] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:36:36 2022] POST /identity/v3/users => generated 249 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jul 27 07:36:37.068898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 07:36:37.069809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application yield resource Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise self.value Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application session.commit() Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 07:36:37.070726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.flush() Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application compat.raise_( Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 07:36:37.071651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 07:36:37.072515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 07:36:37.073337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [parameters: {'id': '8938708d57e441c0a6316d3d71571b2a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:37.074133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 07:36:37.080203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:37.082232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 231/478] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 27 07:36:36 2022] POST /identity/v3/roles => generated 144 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:37.084195 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fded5-c2ae-490f-aad0-e2d1f9cd62de None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:37.238563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fded5-c2ae-490f-aad0-e2d1f9cd62de None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:37.281589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e341d-652d-43c2-8d3e-804bb585b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:37.282164 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e341d-652d-43c2-8d3e-804bb585b039 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:37.282443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e341d-652d-43c2-8d3e-804bb585b039 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:37.282711 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e341d-652d-43c2-8d3e-804bb585b039 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:37.295896 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e341d-652d-43c2-8d3e-804bb585b039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-762e341d-652d-43c2-8d3e-804bb585b039 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:37.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:37.302766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:37.303677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 248/479] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:36:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:37.310461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:37.421176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be5d3a-7dd9-4d81-ade6-d6803ada9cb2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:37.456316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc3b46-27b9-49b0-b67a-d08d38af249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:37.456938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3b46-27b9-49b0-b67a-d08d38af249b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:37.457217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3b46-27b9-49b0-b67a-d08d38af249b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:37.457488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3b46-27b9-49b0-b67a-d08d38af249b None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:37.458214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc3b46-27b9-49b0-b67a-d08d38af249b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:37.458513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc3b46-27b9-49b0-b67a-d08d38af249b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:37.459909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc3b46-27b9-49b0-b67a-d08d38af249b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:37.468481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 232/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:38.340398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8e0f7-adc1-48f1-8d81-e99bc995b7dc None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:38.340925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8e0f7-adc1-48f1-8d81-e99bc995b7dc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:38.340925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8e0f7-adc1-48f1-8d81-e99bc995b7dc None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:38.342529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 249/481] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:38.348717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72c33-f69e-4668-9331-54699f3b9b3d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:38.349621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72c33-f69e-4668-9331-54699f3b9b3d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:38.350116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72c33-f69e-4668-9331-54699f3b9b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:38.380661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-78a72c33-f69e-4668-9331-54699f3b9b3d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:38.382266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-78a72c33-f69e-4668-9331-54699f3b9b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:38.469230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:38.493439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 233/482] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:38.535626 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8e0f7-adc1-48f1-8d81-e99bc995b7dc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:38.604619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:38.662397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8e0f7-adc1-48f1-8d81-e99bc995b7dc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:38.698501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4496c6-c257-480d-9931-d355394da684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:38.699182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4496c6-c257-480d-9931-d355394da684 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:38.699463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4496c6-c257-480d-9931-d355394da684 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:38.699741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4496c6-c257-480d-9931-d355394da684 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:38.712424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4496c6-c257-480d-9931-d355394da684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9a4496c6-c257-480d-9931-d355394da684 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:38.718162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:38.719176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:38.719967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 250/483] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:38.725560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a72c33-f69e-4668-9331-54699f3b9b3d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:38.768486 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca377462-f519-4046-a667-3b0384cb431d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:38.768813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca377462-f519-4046-a667-3b0384cb431d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:38.769025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca377462-f519-4046-a667-3b0384cb431d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:38.770777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 251/484] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:38.780541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933d178-1664-4857-9675-b8b84f085e79 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:38.781819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933d178-1664-4857-9675-b8b84f085e79 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:38.782099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933d178-1664-4857-9675-b8b84f085e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:38.801167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a933d178-1664-4857-9675-b8b84f085e79 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:38.802356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a933d178-1664-4857-9675-b8b84f085e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:38.860887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a72c33-f69e-4668-9331-54699f3b9b3d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:38.881601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 252/485] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:38.923613 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439f609-a191-4321-9afb-f9b59eb5a02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:38.924254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439f609-a191-4321-9afb-f9b59eb5a02d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:38.924537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439f609-a191-4321-9afb-f9b59eb5a02d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:38.924811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439f609-a191-4321-9afb-f9b59eb5a02d None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:38.925555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439f609-a191-4321-9afb-f9b59eb5a02d None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:38.925872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439f609-a191-4321-9afb-f9b59eb5a02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:38.927307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439f609-a191-4321-9afb-f9b59eb5a02d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:38.936505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 234/486] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:38.942576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933d178-1664-4857-9675-b8b84f085e79 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:38.947536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439f609-a191-4321-9afb-f9b59eb5a02d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.030200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:39.036682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:39.085035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439f609-a191-4321-9afb-f9b59eb5a02d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.106602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933d178-1664-4857-9675-b8b84f085e79 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.129268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21679c-15b0-41ad-bdb6-e7ed4847bca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.129848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21679c-15b0-41ad-bdb6-e7ed4847bca8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.130126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21679c-15b0-41ad-bdb6-e7ed4847bca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.130402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21679c-15b0-41ad-bdb6-e7ed4847bca8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.145699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21679c-15b0-41ad-bdb6-e7ed4847bca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:39.148092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df73f14-002f-4f4e-b933-fc9004f58218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.148805 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df73f14-002f-4f4e-b933-fc9004f58218 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.149153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df73f14-002f-4f4e-b933-fc9004f58218 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.149496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df73f14-002f-4f4e-b933-fc9004f58218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0e21679c-15b0-41ad-bdb6-e7ed4847bca8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:39.156136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:39.157878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 235/487] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:39.159383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed688ee-78a7-4092-9f6b-2f82b1f3172b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.160669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed688ee-78a7-4092-9f6b-2f82b1f3172b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.160669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed688ee-78a7-4092-9f6b-2f82b1f3172b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.163178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 236/488] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:39.166485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed688ee-78a7-4092-9f6b-2f82b1f3172b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.169547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df73f14-002f-4f4e-b933-fc9004f58218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:39.172323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df73f14-002f-4f4e-b933-fc9004f58218 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8df73f14-002f-4f4e-b933-fc9004f58218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:39.191319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:39.192223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:39.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:39.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:39.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:39.193066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:39.200038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 253/489] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:39.200548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b21d-7fff-4fe6-896f-352091e8e7cd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.200654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b21d-7fff-4fe6-896f-352091e8e7cd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.200920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b21d-7fff-4fe6-896f-352091e8e7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.221025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ff21b21d-7fff-4fe6-896f-352091e8e7cd None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:39.222479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ff21b21d-7fff-4fe6-896f-352091e8e7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:39.285869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed688ee-78a7-4092-9f6b-2f82b1f3172b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.299173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 254/490] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:39.300216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21b21d-7fff-4fe6-896f-352091e8e7cd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.315315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:39.325335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66494906-bdab-47bc-b50d-4edb4ed6722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.326257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66494906-bdab-47bc-b50d-4edb4ed6722e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.326742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66494906-bdab-47bc-b50d-4edb4ed6722e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.327496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66494906-bdab-47bc-b50d-4edb4ed6722e None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.328562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66494906-bdab-47bc-b50d-4edb4ed6722e None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:39.329162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66494906-bdab-47bc-b50d-4edb4ed6722e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:39.330936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66494906-bdab-47bc-b50d-4edb4ed6722e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:39.340610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 237/491] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:39.346010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66494906-bdab-47bc-b50d-4edb4ed6722e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.347082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:39.424039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21b21d-7fff-4fe6-896f-352091e8e7cd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.460481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66494906-bdab-47bc-b50d-4edb4ed6722e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.462310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667172-cfdf-4549-b5d6-1fd554cf2504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.462984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667172-cfdf-4549-b5d6-1fd554cf2504 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.463433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667172-cfdf-4549-b5d6-1fd554cf2504 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.463879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667172-cfdf-4549-b5d6-1fd554cf2504 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.464715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667172-cfdf-4549-b5d6-1fd554cf2504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:39.465162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667172-cfdf-4549-b5d6-1fd554cf2504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:39.466713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667172-cfdf-4549-b5d6-1fd554cf2504 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:39.479318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 255/492] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:39.480381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667172-cfdf-4549-b5d6-1fd554cf2504 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.509932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489f846-2f8c-4926-85da-d4b235bb940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.510835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489f846-2f8c-4926-85da-d4b235bb940d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.511277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489f846-2f8c-4926-85da-d4b235bb940d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.511723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489f846-2f8c-4926-85da-d4b235bb940d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.524290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489f846-2f8c-4926-85da-d4b235bb940d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b489f846-2f8c-4926-85da-d4b235bb940d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:39.529896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:39.530878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:39.532295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:39.532903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 238/493] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:39.538025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489f846-2f8c-4926-85da-d4b235bb940d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.572584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:39.583733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:39.596749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667172-cfdf-4549-b5d6-1fd554cf2504 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.632470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf58a6-46fb-4415-9cf0-c77e3f6c8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.633271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf58a6-46fb-4415-9cf0-c77e3f6c8e30 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.633655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf58a6-46fb-4415-9cf0-c77e3f6c8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.634037 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf58a6-46fb-4415-9cf0-c77e3f6c8e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.645607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf58a6-46fb-4415-9cf0-c77e3f6c8e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:39.647237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf58a6-46fb-4415-9cf0-c77e3f6c8e30 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:39.651715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489f846-2f8c-4926-85da-d4b235bb940d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-91cf58a6-46fb-4415-9cf0-c77e3f6c8e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:39.662812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:39.663905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:39.664748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:39.664748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:39.664748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:39.664748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:39.664959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 256/494] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:39.669824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf58a6-46fb-4415-9cf0-c77e3f6c8e30 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.699237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535694e5-e810-4bc5-b36c-807ebcbb790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.700179 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535694e5-e810-4bc5-b36c-807ebcbb790d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.700644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535694e5-e810-4bc5-b36c-807ebcbb790d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.701095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535694e5-e810-4bc5-b36c-807ebcbb790d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.709889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535694e5-e810-4bc5-b36c-807ebcbb790d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:39.711817 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535694e5-e810-4bc5-b36c-807ebcbb790d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-535694e5-e810-4bc5-b36c-807ebcbb790d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:39.727777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:39.728723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:36:39.729604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:39.736877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 239/495] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 27 07:36:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:39.738004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535694e5-e810-4bc5-b36c-807ebcbb790d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.773493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf58a6-46fb-4415-9cf0-c77e3f6c8e30 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.814382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68c7ee-b7e4-4f48-8b3d-3bd481b3746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.815028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68c7ee-b7e4-4f48-8b3d-3bd481b3746d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.815309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68c7ee-b7e4-4f48-8b3d-3bd481b3746d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.815583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68c7ee-b7e4-4f48-8b3d-3bd481b3746d None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.816302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68c7ee-b7e4-4f48-8b3d-3bd481b3746d None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:39.816606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68c7ee-b7e4-4f48-8b3d-3bd481b3746d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:39.818005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68c7ee-b7e4-4f48-8b3d-3bd481b3746d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:39.831847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 257/496] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:39.831847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68c7ee-b7e4-4f48-8b3d-3bd481b3746d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.832462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:39.845369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:39.851923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535694e5-e810-4bc5-b36c-807ebcbb790d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.900448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042aca24-2de8-4fc8-a3fe-0931e413638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.901071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aca24-2de8-4fc8-a3fe-0931e413638b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.901460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aca24-2de8-4fc8-a3fe-0931e413638b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.901651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aca24-2de8-4fc8-a3fe-0931e413638b None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.902325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aca24-2de8-4fc8-a3fe-0931e413638b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:39.902631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aca24-2de8-4fc8-a3fe-0931e413638b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:39.904040 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aca24-2de8-4fc8-a3fe-0931e413638b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:39.917185 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 240/497] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:39.918445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546d329-c6bc-4f90-9700-47a91e292b89 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.918795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546d329-c6bc-4f90-9700-47a91e292b89 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.919022 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546d329-c6bc-4f90-9700-47a91e292b89 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.924437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 241/498] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:39.924437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546d329-c6bc-4f90-9700-47a91e292b89 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:39.962148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68c7ee-b7e4-4f48-8b3d-3bd481b3746d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:39.997768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb7d40-3408-47d5-8d7b-cfdfc0490c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:39.998331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb7d40-3408-47d5-8d7b-cfdfc0490c86 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:39.998610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb7d40-3408-47d5-8d7b-cfdfc0490c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:39.998878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb7d40-3408-47d5-8d7b-cfdfc0490c86 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:39.999718 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb7d40-3408-47d5-8d7b-cfdfc0490c86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:40.000593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb7d40-3408-47d5-8d7b-cfdfc0490c86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:40.002032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb7d40-3408-47d5-8d7b-cfdfc0490c86 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:40.034368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546d329-c6bc-4f90-9700-47a91e292b89 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.039044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 258/499] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 27 07:36:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:40.039886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb7d40-3408-47d5-8d7b-cfdfc0490c86 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.069005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22fa76-a954-4af2-ab72-bac51c384dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.069752 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22fa76-a954-4af2-ab72-bac51c384dff None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.070099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22fa76-a954-4af2-ab72-bac51c384dff None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.070439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22fa76-a954-4af2-ab72-bac51c384dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.080604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22fa76-a954-4af2-ab72-bac51c384dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:40.082060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22fa76-a954-4af2-ab72-bac51c384dff None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1d22fa76-a954-4af2-ab72-bac51c384dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:40.097549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:40.098597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:40.099908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:40.099908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:40.099908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:40.099908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:40.099908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 242/500] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:40.099908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06082c-fa33-43e0-bea3-481e4d69cc7f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.100235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06082c-fa33-43e0-bea3-481e4d69cc7f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.100424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06082c-fa33-43e0-bea3-481e4d69cc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.103990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:40.118922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fa06082c-fa33-43e0-bea3-481e4d69cc7f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:40.120145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa06082c-fa33-43e0-bea3-481e4d69cc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:40.122178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:40.145978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb7d40-3408-47d5-8d7b-cfdfc0490c86 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.179855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca5cbc-301a-4e9d-8492-1bc9f0258a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.180497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca5cbc-301a-4e9d-8492-1bc9f0258a77 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.180782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca5cbc-301a-4e9d-8492-1bc9f0258a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.181074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca5cbc-301a-4e9d-8492-1bc9f0258a77 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.198906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 243/501] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:40.199077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca5cbc-301a-4e9d-8492-1bc9f0258a77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:40.199167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aac10f-408e-44b6-b0bc-2e3850aaa1bb None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.199167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aac10f-408e-44b6-b0bc-2e3850aaa1bb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.199167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aac10f-408e-44b6-b0bc-2e3850aaa1bb None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.199382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca5cbc-301a-4e9d-8492-1bc9f0258a77 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:40.199465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 244/502] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:40.199465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aac10f-408e-44b6-b0bc-2e3850aaa1bb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d6ca5cbc-301a-4e9d-8492-1bc9f0258a77 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:40.207555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:40.208632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 259/503] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:40.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca5cbc-301a-4e9d-8492-1bc9f0258a77 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.302749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aac10f-408e-44b6-b0bc-2e3850aaa1bb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.310723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca5cbc-301a-4e9d-8492-1bc9f0258a77 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.330939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:40.337096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bc529-deed-4cc9-8eee-45e06df6f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.337716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bc529-deed-4cc9-8eee-45e06df6f200 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.337994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bc529-deed-4cc9-8eee-45e06df6f200 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.338264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bc529-deed-4cc9-8eee-45e06df6f200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.346289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1b022-4631-4222-ae06-5b2e571af5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.347196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b022-4631-4222-ae06-5b2e571af5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.347748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:40.347835 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b022-4631-4222-ae06-5b2e571af5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.347918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b022-4631-4222-ae06-5b2e571af5e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.348791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1b022-4631-4222-ae06-5b2e571af5e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:40.349223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1b022-4631-4222-ae06-5b2e571af5e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:40.350617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1b022-4631-4222-ae06-5b2e571af5e4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:40.362559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 260/504] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:40.363795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c736-3411-455c-bd4d-1ce6f3a828d0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.364074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c736-3411-455c-bd4d-1ce6f3a828d0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.364430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c736-3411-455c-bd4d-1ce6f3a828d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.382115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4668c736-3411-455c-bd4d-1ce6f3a828d0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:40.383337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4668c736-3411-455c-bd4d-1ce6f3a828d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:40.409217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bc529-deed-4cc9-8eee-45e06df6f200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:40.410666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bc529-deed-4cc9-8eee-45e06df6f200 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:40.450266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 261/505] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:40.451213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668c736-3411-455c-bd4d-1ce6f3a828d0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.514092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 245/506] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:40.515038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bc529-deed-4cc9-8eee-45e06df6f200 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.554507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:40.565947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668c736-3411-455c-bd4d-1ce6f3a828d0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.576851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:40.601510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb18852-473d-4de5-99e6-6c228250157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.602118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb18852-473d-4de5-99e6-6c228250157a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.602394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb18852-473d-4de5-99e6-6c228250157a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.602666 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb18852-473d-4de5-99e6-6c228250157a None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.603512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb18852-473d-4de5-99e6-6c228250157a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:40.603816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb18852-473d-4de5-99e6-6c228250157a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:40.605264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb18852-473d-4de5-99e6-6c228250157a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:40.614961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bc529-deed-4cc9-8eee-45e06df6f200 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.622617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 262/507] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:40.623557 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb18852-473d-4de5-99e6-6c228250157a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.649857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7441-4e4c-4cde-8ca6-1c5296938dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.650507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7441-4e4c-4cde-8ca6-1c5296938dce None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.650785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7441-4e4c-4cde-8ca6-1c5296938dce None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.651083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7441-4e4c-4cde-8ca6-1c5296938dce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.661824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec7441-4e4c-4cde-8ca6-1c5296938dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-66ec7441-4e4c-4cde-8ca6-1c5296938dce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:40.666711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:40.667728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:40.668524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 246/508] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:40.669546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7441-4e4c-4cde-8ca6-1c5296938dce None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.729484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb18852-473d-4de5-99e6-6c228250157a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.764466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdb764-5679-49e6-8062-8057f5314630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.765091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb764-5679-49e6-8062-8057f5314630 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.765889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb764-5679-49e6-8062-8057f5314630 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.766157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb764-5679-49e6-8062-8057f5314630 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.766674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:40.771110 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7441-4e4c-4cde-8ca6-1c5296938dce None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.774427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdb764-5679-49e6-8062-8057f5314630 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:40.775918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdb764-5679-49e6-8062-8057f5314630 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-97bdb764-5679-49e6-8062-8057f5314630 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:40.787959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:40.788926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:40.789830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 263/509] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:40.790951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdb764-5679-49e6-8062-8057f5314630 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.810091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d00c2-c155-486f-b574-95b7e9a0208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.810642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d00c2-c155-486f-b574-95b7e9a0208e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.810947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d00c2-c155-486f-b574-95b7e9a0208e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.811222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d00c2-c155-486f-b574-95b7e9a0208e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.818314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:40.821895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d00c2-c155-486f-b574-95b7e9a0208e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:40.823431 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d00c2-c155-486f-b574-95b7e9a0208e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b50d00c2-c155-486f-b574-95b7e9a0208e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:40.840537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:40.841597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:40.842585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:40.842585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:40.842585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:40.842585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:40.842585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 247/510] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:40.847793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d00c2-c155-486f-b574-95b7e9a0208e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.898389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdb764-5679-49e6-8062-8057f5314630 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.933333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bf44-1d47-4019-80df-8db970bdcf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.933978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bf44-1d47-4019-80df-8db970bdcf9d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.934262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bf44-1d47-4019-80df-8db970bdcf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.934533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bf44-1d47-4019-80df-8db970bdcf9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:40.945152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bf44-1d47-4019-80df-8db970bdcf9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:40.946676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bf44-1d47-4019-80df-8db970bdcf9d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:40.949821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d00c2-c155-486f-b574-95b7e9a0208e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8fc1bf44-1d47-4019-80df-8db970bdcf9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:40.961184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:40.962191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:40.967678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:40.967678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:40.967678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:40.967678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:40.967678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 264/511] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:40.967678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bf44-1d47-4019-80df-8db970bdcf9d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:40.988879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16733bab-e3e0-4354-b09b-efae77108a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:40.989496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16733bab-e3e0-4354-b09b-efae77108a32 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:40.989769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16733bab-e3e0-4354-b09b-efae77108a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:40.990040 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16733bab-e3e0-4354-b09b-efae77108a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.007711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:41.044110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:41.056505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16733bab-e3e0-4354-b09b-efae77108a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.057959 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16733bab-e3e0-4354-b09b-efae77108a32 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.063579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bf44-1d47-4019-80df-8db970bdcf9d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.097176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cc0bb-3a3b-4330-9a20-4d833f31cdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.097788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cc0bb-3a3b-4330-9a20-4d833f31cdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.098067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cc0bb-3a3b-4330-9a20-4d833f31cdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.098337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cc0bb-3a3b-4330-9a20-4d833f31cdb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.099088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cc0bb-3a3b-4330-9a20-4d833f31cdb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:41.099390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cc0bb-3a3b-4330-9a20-4d833f31cdb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.100757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cc0bb-3a3b-4330-9a20-4d833f31cdb6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.108764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 265/512] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:41.109596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cc0bb-3a3b-4330-9a20-4d833f31cdb6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.162057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 248/513] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:41.163148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16733bab-e3e0-4354-b09b-efae77108a32 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.212112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cc0bb-3a3b-4330-9a20-4d833f31cdb6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.213420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:41.245378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5095b4-2981-42db-a672-ff61b80e7300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.245989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5095b4-2981-42db-a672-ff61b80e7300 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.246271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5095b4-2981-42db-a672-ff61b80e7300 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.246544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5095b4-2981-42db-a672-ff61b80e7300 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.247366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5095b4-2981-42db-a672-ff61b80e7300 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:41.247673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5095b4-2981-42db-a672-ff61b80e7300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.249105 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5095b4-2981-42db-a672-ff61b80e7300 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.263332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:41.263521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16733bab-e3e0-4354-b09b-efae77108a32 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.271232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 266/514] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:41.272576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5095b4-2981-42db-a672-ff61b80e7300 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.297830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09229d9a-a303-4b9c-af7b-5a3f2b08152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.298446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09229d9a-a303-4b9c-af7b-5a3f2b08152b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.298725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09229d9a-a303-4b9c-af7b-5a3f2b08152b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.299030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09229d9a-a303-4b9c-af7b-5a3f2b08152b None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.299730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09229d9a-a303-4b9c-af7b-5a3f2b08152b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:41.300033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09229d9a-a303-4b9c-af7b-5a3f2b08152b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.301407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09229d9a-a303-4b9c-af7b-5a3f2b08152b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.313405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 249/515] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:41.314270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09229d9a-a303-4b9c-af7b-5a3f2b08152b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.376025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5095b4-2981-42db-a672-ff61b80e7300 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.410377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f8d8a-5db7-4245-b45a-78f19e88307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.411099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f8d8a-5db7-4245-b45a-78f19e88307c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.411379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f8d8a-5db7-4245-b45a-78f19e88307c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.411648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f8d8a-5db7-4245-b45a-78f19e88307c None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.412331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f8d8a-5db7-4245-b45a-78f19e88307c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:41.412632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f8d8a-5db7-4245-b45a-78f19e88307c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.414001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f8d8a-5db7-4245-b45a-78f19e88307c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.415910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09229d9a-a303-4b9c-af7b-5a3f2b08152b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.426236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 267/516] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:41.427511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f8d8a-5db7-4245-b45a-78f19e88307c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.431992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:41.457282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81da92d-1f08-4709-b92c-b02259df7365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.457921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81da92d-1f08-4709-b92c-b02259df7365 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.458203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81da92d-1f08-4709-b92c-b02259df7365 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.458472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81da92d-1f08-4709-b92c-b02259df7365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.469600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81da92d-1f08-4709-b92c-b02259df7365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.471075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81da92d-1f08-4709-b92c-b02259df7365 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f81da92d-1f08-4709-b92c-b02259df7365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:41.485321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:41.486208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:41.487072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:41.487072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:41.487072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:41.487072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:41.487307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:41.487379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 250/517] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:41.487379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81da92d-1f08-4709-b92c-b02259df7365 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.530848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f8d8a-5db7-4245-b45a-78f19e88307c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.564777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c9270-9a12-4b73-98f2-9676f75b53f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.565338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c9270-9a12-4b73-98f2-9676f75b53f4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.565619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c9270-9a12-4b73-98f2-9676f75b53f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.565888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c9270-9a12-4b73-98f2-9676f75b53f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.576639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c9270-9a12-4b73-98f2-9676f75b53f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.578567 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c9270-9a12-4b73-98f2-9676f75b53f4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.585173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81da92d-1f08-4709-b92c-b02259df7365 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2a6c9270-9a12-4b73-98f2-9676f75b53f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:41.592963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:41.594521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:41.595408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:41.595408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:41.595408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:41.595408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:41.595408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 268/518] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:41.595665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c9270-9a12-4b73-98f2-9676f75b53f4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.620410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f916f9-ab4e-4193-89ec-07a547eeaf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.621035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f916f9-ab4e-4193-89ec-07a547eeaf1c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.621311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f916f9-ab4e-4193-89ec-07a547eeaf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.621583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f916f9-ab4e-4193-89ec-07a547eeaf1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.650630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:41.688947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f916f9-ab4e-4193-89ec-07a547eeaf1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.690513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f916f9-ab4e-4193-89ec-07a547eeaf1c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.696013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c9270-9a12-4b73-98f2-9676f75b53f4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.709325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:41.731837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee26eb7-fa9c-4fde-9d63-ab16b78bd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.731837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee26eb7-fa9c-4fde-9d63-ab16b78bd523 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.732224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee26eb7-fa9c-4fde-9d63-ab16b78bd523 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.732506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee26eb7-fa9c-4fde-9d63-ab16b78bd523 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.733222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee26eb7-fa9c-4fde-9d63-ab16b78bd523 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.734631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee26eb7-fa9c-4fde-9d63-ab16b78bd523 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.755529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 269/519] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:36:41 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:36:41.756344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee26eb7-fa9c-4fde-9d63-ab16b78bd523 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.797647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 251/520] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:41.798949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f916f9-ab4e-4193-89ec-07a547eeaf1c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.875884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:41.913322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee26eb7-fa9c-4fde-9d63-ab16b78bd523 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.929895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f916f9-ab4e-4193-89ec-07a547eeaf1c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:41.961295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b25e-adba-4b60-8b44-3156135c03c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.961959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b25e-adba-4b60-8b44-3156135c03c5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.962237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b25e-adba-4b60-8b44-3156135c03c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.962514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b25e-adba-4b60-8b44-3156135c03c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.971267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342b25e-adba-4b60-8b44-3156135c03c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.972996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342b25e-adba-4b60-8b44-3156135c03c5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.975470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb2df-5df0-4441-8cbd-37dc1b2d1c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:41.976105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb2df-5df0-4441-8cbd-37dc1b2d1c93 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:41.976384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb2df-5df0-4441-8cbd-37dc1b2d1c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:41.976657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb2df-5df0-4441-8cbd-37dc1b2d1c93 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:41.977366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefb2df-5df0-4441-8cbd-37dc1b2d1c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:41.977671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefb2df-5df0-4441-8cbd-37dc1b2d1c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:41.979149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefb2df-5df0-4441-8cbd-37dc1b2d1c93 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6342b25e-adba-4b60-8b44-3156135c03c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:41.986182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:41.987131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:41.988043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:41.988043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:41.988043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:41.988043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:41.988043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:41.988043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:41.988043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:41.988043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:41.988043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 270/521] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:41.988526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b25e-adba-4b60-8b44-3156135c03c5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:41.993596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 252/522] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:41.994446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb2df-5df0-4441-8cbd-37dc1b2d1c93 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.019194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:42.098545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b25e-adba-4b60-8b44-3156135c03c5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.106121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb2df-5df0-4441-8cbd-37dc1b2d1c93 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.131675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:42.138532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06fb76-b80c-441d-8857-3bce48748e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.139376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06fb76-b80c-441d-8857-3bce48748e8f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.139579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06fb76-b80c-441d-8857-3bce48748e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.139829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06fb76-b80c-441d-8857-3bce48748e8f None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.140640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06fb76-b80c-441d-8857-3bce48748e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:42.140880 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06fb76-b80c-441d-8857-3bce48748e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.142263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06fb76-b80c-441d-8857-3bce48748e8f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.143888 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71abc7f-1e5c-4fae-affa-524dcc212249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.144522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71abc7f-1e5c-4fae-affa-524dcc212249 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.144804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71abc7f-1e5c-4fae-affa-524dcc212249 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.145071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71abc7f-1e5c-4fae-affa-524dcc212249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.158590 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71abc7f-1e5c-4fae-affa-524dcc212249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.158590 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71abc7f-1e5c-4fae-affa-524dcc212249 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.161117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 271/523] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:42.161897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06fb76-b80c-441d-8857-3bce48748e8f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e71abc7f-1e5c-4fae-affa-524dcc212249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:42.173726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:42.174598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:42.175609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:42.175609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:42.175609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:42.175609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:42.175609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 253/524] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:42.175896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71abc7f-1e5c-4fae-affa-524dcc212249 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.267008 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:42.279581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06fb76-b80c-441d-8857-3bce48748e8f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.295301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71abc7f-1e5c-4fae-affa-524dcc212249 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.317657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16681-31c2-4e12-a6f6-6dced59fdbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.318299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16681-31c2-4e12-a6f6-6dced59fdbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.318578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16681-31c2-4e12-a6f6-6dced59fdbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.318850 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16681-31c2-4e12-a6f6-6dced59fdbf8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.326224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c16681-31c2-4e12-a6f6-6dced59fdbf8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.327765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c16681-31c2-4e12-a6f6-6dced59fdbf8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.333764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade52af1-bf25-4bd5-89e9-bf47d61dbaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.334404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade52af1-bf25-4bd5-89e9-bf47d61dbaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.334676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade52af1-bf25-4bd5-89e9-bf47d61dbaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.334971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade52af1-bf25-4bd5-89e9-bf47d61dbaf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.335737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade52af1-bf25-4bd5-89e9-bf47d61dbaf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:42.336046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade52af1-bf25-4bd5-89e9-bf47d61dbaf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.337474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade52af1-bf25-4bd5-89e9-bf47d61dbaf7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d8c16681-31c2-4e12-a6f6-6dced59fdbf8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:42.339757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:42.340624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 07:36:42.341579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:42.345778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 272/525] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:42.346763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16681-31c2-4e12-a6f6-6dced59fdbf8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.362855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 254/526] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:42.362855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade52af1-bf25-4bd5-89e9-bf47d61dbaf7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.399325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:42.469773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16681-31c2-4e12-a6f6-6dced59fdbf8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.474955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade52af1-bf25-4bd5-89e9-bf47d61dbaf7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.507369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6369ab5-306a-46c7-b54a-e39b3529706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.508008 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6369ab5-306a-46c7-b54a-e39b3529706b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.508299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6369ab5-306a-46c7-b54a-e39b3529706b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.508550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6369ab5-306a-46c7-b54a-e39b3529706b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.513798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82e49a-f2a5-4d95-82da-14269d6f3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.514424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82e49a-f2a5-4d95-82da-14269d6f3af9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.514709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82e49a-f2a5-4d95-82da-14269d6f3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.515015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82e49a-f2a5-4d95-82da-14269d6f3af9 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.515722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6369ab5-306a-46c7-b54a-e39b3529706b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.515934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82e49a-f2a5-4d95-82da-14269d6f3af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:42.516377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82e49a-f2a5-4d95-82da-14269d6f3af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.517569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6369ab5-306a-46c7-b54a-e39b3529706b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.517910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82e49a-f2a5-4d95-82da-14269d6f3af9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.534548 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 255/527] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:42.534548 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82e49a-f2a5-4d95-82da-14269d6f3af9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d6369ab5-306a-46c7-b54a-e39b3529706b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:42.535536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:42.539146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 273/528] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:42.540650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6369ab5-306a-46c7-b54a-e39b3529706b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.555034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:42.646801 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:42.654869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6369ab5-306a-46c7-b54a-e39b3529706b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.655040 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82e49a-f2a5-4d95-82da-14269d6f3af9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.690606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec46dd-6b71-40e1-9d32-3daaf1f3e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.691240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec46dd-6b71-40e1-9d32-3daaf1f3e4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.691519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec46dd-6b71-40e1-9d32-3daaf1f3e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.691793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec46dd-6b71-40e1-9d32-3daaf1f3e4c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.692575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec46dd-6b71-40e1-9d32-3daaf1f3e4c7 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=0445b52b85994510ad9e66de366ebf4d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:42.692883 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec46dd-6b71-40e1-9d32-3daaf1f3e4c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.693073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55040b73-fc7d-4914-b195-455ee5cc24b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.693690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040b73-fc7d-4914-b195-455ee5cc24b4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.693973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040b73-fc7d-4914-b195-455ee5cc24b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.694244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040b73-fc7d-4914-b195-455ee5cc24b4 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.694336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec46dd-6b71-40e1-9d32-3daaf1f3e4c7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.695073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55040b73-fc7d-4914-b195-455ee5cc24b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:42.695381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55040b73-fc7d-4914-b195-455ee5cc24b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.696805 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55040b73-fc7d-4914-b195-455ee5cc24b4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.707307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 274/529] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/role_assignments?user.id=0445b52b85994510ad9e66de366ebf4d&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:42.707307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec46dd-6b71-40e1-9d32-3daaf1f3e4c7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.739353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 256/530] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:42.740251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55040b73-fc7d-4914-b195-455ee5cc24b4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.802400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:42.838029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec46dd-6b71-40e1-9d32-3daaf1f3e4c7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.880939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d8466-e8f6-4574-bd0e-57d5c2c8fae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.881795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d8466-e8f6-4574-bd0e-57d5c2c8fae2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.882949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d8466-e8f6-4574-bd0e-57d5c2c8fae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.883327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d8466-e8f6-4574-bd0e-57d5c2c8fae2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.896437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55040b73-fc7d-4914-b195-455ee5cc24b4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:42.898054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d8466-e8f6-4574-bd0e-57d5c2c8fae2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.899841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d8466-e8f6-4574-bd0e-57d5c2c8fae2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b66d8466-e8f6-4574-bd0e-57d5c2c8fae2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:42.912930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:42.914027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:42.915128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:42.915128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:42.915128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:42.915128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:42.915128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:42.915128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:42.915128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:42.915128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:42.916801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 275/531] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:42.916937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d8466-e8f6-4574-bd0e-57d5c2c8fae2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.946342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11c59-e712-441c-9958-fc1ddb904c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:42.947508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11c59-e712-441c-9958-fc1ddb904c31 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:42.948093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11c59-e712-441c-9958-fc1ddb904c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:42.948540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11c59-e712-441c-9958-fc1ddb904c31 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:42.950048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e11c59-e712-441c-9958-fc1ddb904c31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:42.950530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e11c59-e712-441c-9958-fc1ddb904c31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:42.953471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e11c59-e712-441c-9958-fc1ddb904c31 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:42.967441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 257/532] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:42.970153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11c59-e712-441c-9958-fc1ddb904c31 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:42.989753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:43.051915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d8466-e8f6-4574-bd0e-57d5c2c8fae2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:43.087858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:43.095199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e56b-6067-49d5-8e57-cfd2400965ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:43.096124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e56b-6067-49d5-8e57-cfd2400965ad None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:43.096868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e56b-6067-49d5-8e57-cfd2400965ad None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:43.097483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e56b-6067-49d5-8e57-cfd2400965ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:43.116563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11c59-e712-441c-9958-fc1ddb904c31 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:43.167098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885b74-6fe7-4269-b1de-a5590d6ec6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:43.168223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885b74-6fe7-4269-b1de-a5590d6ec6cf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:43.168647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885b74-6fe7-4269-b1de-a5590d6ec6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:43.169563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885b74-6fe7-4269-b1de-a5590d6ec6cf None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:43.170786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69885b74-6fe7-4269-b1de-a5590d6ec6cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:43.171290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69885b74-6fe7-4269-b1de-a5590d6ec6cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:43.173523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69885b74-6fe7-4269-b1de-a5590d6ec6cf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:43.177771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e56b-6067-49d5-8e57-cfd2400965ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:43.179481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e56b-6067-49d5-8e57-cfd2400965ad None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:43.190677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 258/533] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:43.191516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885b74-6fe7-4269-b1de-a5590d6ec6cf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:43.276369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:43.308954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885b74-6fe7-4269-b1de-a5590d6ec6cf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:43.329387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 276/534] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:43.329387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e56b-6067-49d5-8e57-cfd2400965ad None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:43.353418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600e656-1390-4dc3-9374-f92c6803b8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:43.354115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600e656-1390-4dc3-9374-f92c6803b8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:43.354322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600e656-1390-4dc3-9374-f92c6803b8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:43.354597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600e656-1390-4dc3-9374-f92c6803b8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:43.355432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600e656-1390-4dc3-9374-f92c6803b8e8 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=ad7a3c5f6b9645fb8cd2a65cee4f37c9) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:43.355739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600e656-1390-4dc3-9374-f92c6803b8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:43.357175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600e656-1390-4dc3-9374-f92c6803b8e8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:43.363951 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 259/535] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:43 2022] GET /identity/v3/role_assignments?user.id=ad7a3c5f6b9645fb8cd2a65cee4f37c9&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:43.364902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600e656-1390-4dc3-9374-f92c6803b8e8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:43.372292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:43.473355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e56b-6067-49d5-8e57-cfd2400965ad None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:43.516315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533080d-9a5a-40d4-8838-20ba559d69a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:43.517207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533080d-9a5a-40d4-8838-20ba559d69a4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:43.517580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533080d-9a5a-40d4-8838-20ba559d69a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:43.517950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533080d-9a5a-40d4-8838-20ba559d69a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:43.518847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533080d-9a5a-40d4-8838-20ba559d69a4 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=ae1eae16b54c46e9a92f423094085b70) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:43.519271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533080d-9a5a-40d4-8838-20ba559d69a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:43.522906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533080d-9a5a-40d4-8838-20ba559d69a4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:43.528737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 277/536] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:43 2022] GET /identity/v3/role_assignments?user.id=ae1eae16b54c46e9a92f423094085b70&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:43.607311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600e656-1390-4dc3-9374-f92c6803b8e8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:43.645133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b621f8a-8d6c-419d-ac91-250f703db6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:43.646244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b621f8a-8d6c-419d-ac91-250f703db6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:43.646686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b621f8a-8d6c-419d-ac91-250f703db6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:43.647138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b621f8a-8d6c-419d-ac91-250f703db6c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:43.651837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:43.662317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b621f8a-8d6c-419d-ac91-250f703db6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:43.664093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b621f8a-8d6c-419d-ac91-250f703db6c1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6b621f8a-8d6c-419d-ac91-250f703db6c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:43.681074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:43.682132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:43.683207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:43.683207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:43.683207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:43.683207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:43.685098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 260/537] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:43.690625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533080d-9a5a-40d4-8838-20ba559d69a4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:43.824025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:43.833336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533080d-9a5a-40d4-8838-20ba559d69a4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:43.837379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e73c-5439-4313-b84e-8744d2eff2c5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:43.837661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e73c-5439-4313-b84e-8744d2eff2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:43.837934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e73c-5439-4313-b84e-8744d2eff2c5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:43.843218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 261/538] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:36:43.844648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87286554-cf1d-4f16-8dc0-3feb5ab9c5c1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:43.844930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87286554-cf1d-4f16-8dc0-3feb5ab9c5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:43.845201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87286554-cf1d-4f16-8dc0-3feb5ab9c5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:43.879929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-87286554-cf1d-4f16-8dc0-3feb5ab9c5c1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:43.881779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2bd33-648b-45fa-9176-7fec12a2406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:43.882454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2bd33-648b-45fa-9176-7fec12a2406b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:43.882740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2bd33-648b-45fa-9176-7fec12a2406b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:43.883041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2bd33-648b-45fa-9176-7fec12a2406b None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:43.883752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2bd33-648b-45fa-9176-7fec12a2406b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:43.884058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2bd33-648b-45fa-9176-7fec12a2406b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:43.885465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2bd33-648b-45fa-9176-7fec12a2406b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:43.887971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-87286554-cf1d-4f16-8dc0-3feb5ab9c5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:43.917071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 278/539] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:43.923480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2bd33-648b-45fa-9176-7fec12a2406b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:44.024531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 262/540] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:44.059974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87286554-cf1d-4f16-8dc0-3feb5ab9c5c1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:44.076107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2bd33-648b-45fa-9176-7fec12a2406b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:44.124573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a21b1-e660-4a68-a043-10504738509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:44.125725 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a21b1-e660-4a68-a043-10504738509b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:44.126005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a21b1-e660-4a68-a043-10504738509b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:44.126276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a21b1-e660-4a68-a043-10504738509b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:44.144009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a21b1-e660-4a68-a043-10504738509b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:44.145503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a21b1-e660-4a68-a043-10504738509b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-924a21b1-e660-4a68-a043-10504738509b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:44.165033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:44.165922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:44.166749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:44.166749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:44.166749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:44.166749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:44.166749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:44.166749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:44.166749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:44.166749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:44.166749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 279/541] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:44.174895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a21b1-e660-4a68-a043-10504738509b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:44.188651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87286554-cf1d-4f16-8dc0-3feb5ab9c5c1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:44.211271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:44.212862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:44.227326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10a23b-9ec0-4dc9-8d8c-b612cbf8c60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:44.228121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10a23b-9ec0-4dc9-8d8c-b612cbf8c60c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:44.228499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10a23b-9ec0-4dc9-8d8c-b612cbf8c60c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:44.228870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10a23b-9ec0-4dc9-8d8c-b612cbf8c60c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:44.239993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10a23b-9ec0-4dc9-8d8c-b612cbf8c60c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ee10a23b-9ec0-4dc9-8d8c-b612cbf8c60c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:44.244925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:44.246018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:44.247028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:44.249004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 263/542] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:44.256681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10a23b-9ec0-4dc9-8d8c-b612cbf8c60c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:44.318180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a21b1-e660-4a68-a043-10504738509b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:44.353990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eab178-7491-43e4-926b-5a853becbdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:44.355001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eab178-7491-43e4-926b-5a853becbdfd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:44.355507 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eab178-7491-43e4-926b-5a853becbdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:44.355976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eab178-7491-43e4-926b-5a853becbdfd None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:44.356956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eab178-7491-43e4-926b-5a853becbdfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:44.357458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eab178-7491-43e4-926b-5a853becbdfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:44.359246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eab178-7491-43e4-926b-5a853becbdfd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:44.384850 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 280/543] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:44.390806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eab178-7491-43e4-926b-5a853becbdfd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:44.472972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10a23b-9ec0-4dc9-8d8c-b612cbf8c60c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:44.530493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:44.552019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62897f3-b72a-4206-a924-4604764d1dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:44.552644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62897f3-b72a-4206-a924-4604764d1dac None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:44.552919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62897f3-b72a-4206-a924-4604764d1dac None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:44.553187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62897f3-b72a-4206-a924-4604764d1dac None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:44.553916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62897f3-b72a-4206-a924-4604764d1dac None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:44.554213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62897f3-b72a-4206-a924-4604764d1dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:44.555634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62897f3-b72a-4206-a924-4604764d1dac None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:44.572675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 264/544] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:44.576513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eab178-7491-43e4-926b-5a853becbdfd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:44.579333 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62897f3-b72a-4206-a924-4604764d1dac None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:44.643335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf837a-4435-4555-80a3-30e637ff08c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:44.643944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf837a-4435-4555-80a3-30e637ff08c8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:44.644220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf837a-4435-4555-80a3-30e637ff08c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:44.644488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf837a-4435-4555-80a3-30e637ff08c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:44.645279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf837a-4435-4555-80a3-30e637ff08c8 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=0c65277d89a24081a47a7f928f6c6d28) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:44.645589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf837a-4435-4555-80a3-30e637ff08c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:44.647635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf837a-4435-4555-80a3-30e637ff08c8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:44.659728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 281/545] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:44 2022] GET /identity/v3/role_assignments?user.id=0c65277d89a24081a47a7f928f6c6d28&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:44.662507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:44.727585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62897f3-b72a-4206-a924-4604764d1dac None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:44.764633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7553c74-21f4-446f-93c3-b912ef2826d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:44.765856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7553c74-21f4-446f-93c3-b912ef2826d7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:44.766139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7553c74-21f4-446f-93c3-b912ef2826d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:44.766407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7553c74-21f4-446f-93c3-b912ef2826d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:44.789354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7553c74-21f4-446f-93c3-b912ef2826d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:44.790974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7553c74-21f4-446f-93c3-b912ef2826d7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e7553c74-21f4-446f-93c3-b912ef2826d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:44.808047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:44.808940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:44.809773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:44.809773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:44.809773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:44.809773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:44.809773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 265/546] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:44.815623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf837a-4435-4555-80a3-30e637ff08c8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:44.960523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf837a-4435-4555-80a3-30e637ff08c8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:45.011547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec774-e5ed-4911-9a03-53b2211d9c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:45.012567 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec774-e5ed-4911-9a03-53b2211d9c1b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:45.013057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec774-e5ed-4911-9a03-53b2211d9c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:45.013535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec774-e5ed-4911-9a03-53b2211d9c1b None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:45.014469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ec774-e5ed-4911-9a03-53b2211d9c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:45.015002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ec774-e5ed-4911-9a03-53b2211d9c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:45.016635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ec774-e5ed-4911-9a03-53b2211d9c1b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:45.026848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:45.032111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 282/547] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:45.037062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7553c74-21f4-446f-93c3-b912ef2826d7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:45.058801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d438-fea5-42c6-884b-ff46ebc5b505 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:45.059126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d438-fea5-42c6-884b-ff46ebc5b505 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:45.059389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d438-fea5-42c6-884b-ff46ebc5b505 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:45.061080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 283/548] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:45.066668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ae002-8d9a-45db-ab21-71a6566aa443 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:45.066982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ae002-8d9a-45db-ab21-71a6566aa443 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:45.067259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ae002-8d9a-45db-ab21-71a6566aa443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:45.100409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-301ae002-8d9a-45db-ab21-71a6566aa443 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:45.101630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-301ae002-8d9a-45db-ab21-71a6566aa443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:45.159274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:45.179093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7553c74-21f4-446f-93c3-b912ef2826d7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:45.226121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 284/549] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:36:45.244502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8f300-b4f4-47b8-b40f-60ed966c8459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:45.245387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8f300-b4f4-47b8-b40f-60ed966c8459 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:45.245929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8f300-b4f4-47b8-b40f-60ed966c8459 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:45.246362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8f300-b4f4-47b8-b40f-60ed966c8459 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:45.247826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ae002-8d9a-45db-ab21-71a6566aa443 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:45.258719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8f300-b4f4-47b8-b40f-60ed966c8459 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:45.260218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8f300-b4f4-47b8-b40f-60ed966c8459 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-59e8f300-b4f4-47b8-b40f-60ed966c8459 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:45.281717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:45.283187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:36:45.284257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:45.290620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 266/550] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:36:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:45.299883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8f300-b4f4-47b8-b40f-60ed966c8459 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:45.442818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ae002-8d9a-45db-ab21-71a6566aa443 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:45.491650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8f300-b4f4-47b8-b40f-60ed966c8459 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:45.504248 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:45.513323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853732-3490-4e35-85d4-339fe56796ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:45.514186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853732-3490-4e35-85d4-339fe56796ef None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:45.514639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853732-3490-4e35-85d4-339fe56796ef None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:45.515226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853732-3490-4e35-85d4-339fe56796ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:45.533080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18853732-3490-4e35-85d4-339fe56796ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-18853732-3490-4e35-85d4-339fe56796ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:45.544218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:45.545345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:45.546992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:45.550541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 285/551] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:45.556331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853732-3490-4e35-85d4-339fe56796ef None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:45.565249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcec52-d111-4757-b9f8-3493d06a1696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:45.568169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcec52-d111-4757-b9f8-3493d06a1696 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:45.568605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcec52-d111-4757-b9f8-3493d06a1696 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:45.569040 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcec52-d111-4757-b9f8-3493d06a1696 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:45.570057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcec52-d111-4757-b9f8-3493d06a1696 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:45.572349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcec52-d111-4757-b9f8-3493d06a1696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:45.573969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcec52-d111-4757-b9f8-3493d06a1696 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:45.610610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 267/552] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 27 07:36:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:45.616620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcec52-d111-4757-b9f8-3493d06a1696 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:45.637949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:45.761198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853732-3490-4e35-85d4-339fe56796ef None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:45.812891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcec52-d111-4757-b9f8-3493d06a1696 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:45.830084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39469fb0-b145-4965-b956-5eb5a79fc1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:45.830709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39469fb0-b145-4965-b956-5eb5a79fc1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:45.831008 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39469fb0-b145-4965-b956-5eb5a79fc1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:45.831286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39469fb0-b145-4965-b956-5eb5a79fc1b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:45.832069 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39469fb0-b145-4965-b956-5eb5a79fc1b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:45.832377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39469fb0-b145-4965-b956-5eb5a79fc1b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:45.833784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39469fb0-b145-4965-b956-5eb5a79fc1b6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:45.845530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 286/553] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:45.851494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729c46-0f73-460f-b039-851249a10b12 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:45.851814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729c46-0f73-460f-b039-851249a10b12 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:45.852099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e729c46-0f73-460f-b039-851249a10b12 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:45.857286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 287/554] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:45.857286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e729c46-0f73-460f-b039-851249a10b12 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:45.873115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5642c-9236-465d-aba6-9a3a8f4e525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:45.874149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5642c-9236-465d-aba6-9a3a8f4e525e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:45.875518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5642c-9236-465d-aba6-9a3a8f4e525e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:45.876032 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5642c-9236-465d-aba6-9a3a8f4e525e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:45.922116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:45.972438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5642c-9236-465d-aba6-9a3a8f4e525e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:45.974245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5642c-9236-465d-aba6-9a3a8f4e525e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:45.988202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e729c46-0f73-460f-b039-851249a10b12 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:45.989487 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:46.037820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee7d5-ae7b-4bca-93bc-f09cea1d93f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:46.038369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee7d5-ae7b-4bca-93bc-f09cea1d93f5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.038645 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee7d5-ae7b-4bca-93bc-f09cea1d93f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.038936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee7d5-ae7b-4bca-93bc-f09cea1d93f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.053459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ee7d5-ae7b-4bca-93bc-f09cea1d93f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:46.055473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ee7d5-ae7b-4bca-93bc-f09cea1d93f5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a87ee7d5-ae7b-4bca-93bc-f09cea1d93f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:46.070549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:46.071482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:46.072553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:46.072553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:46.072553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:46.072553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:46.072553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 288/555] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:46.073876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a00d82-4927-44ca-82c4-29873f3f398e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.074939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a00d82-4927-44ca-82c4-29873f3f398e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.074939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a00d82-4927-44ca-82c4-29873f3f398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.094104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-38a00d82-4927-44ca-82c4-29873f3f398e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:46.095470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-38a00d82-4927-44ca-82c4-29873f3f398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:46.097543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 268/556] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:46.098561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5642c-9236-465d-aba6-9a3a8f4e525e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.179193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 289/557] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:46.179193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a00d82-4927-44ca-82c4-29873f3f398e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.214990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5642c-9236-465d-aba6-9a3a8f4e525e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:46.218121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:46.227394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:46.253245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d287-5d94-4b00-a200-07787ac768b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:46.253862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d287-5d94-4b00-a200-07787ac768b9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.254138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d287-5d94-4b00-a200-07787ac768b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.254410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d287-5d94-4b00-a200-07787ac768b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.255130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d287-5d94-4b00-a200-07787ac768b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:46.255427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d287-5d94-4b00-a200-07787ac768b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:46.256785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d287-5d94-4b00-a200-07787ac768b9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:46.272503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 269/558] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:46.272503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94c7d5-b53d-4988-9416-96824e3afa09 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.272503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94c7d5-b53d-4988-9416-96824e3afa09 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.272503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94c7d5-b53d-4988-9416-96824e3afa09 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.272503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 270/559] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:46.272503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94c7d5-b53d-4988-9416-96824e3afa09 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.299405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a00d82-4927-44ca-82c4-29873f3f398e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:46.335259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc65b-a11f-4b77-a6ba-a031eb9be76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:46.335894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc65b-a11f-4b77-a6ba-a031eb9be76c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.336170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc65b-a11f-4b77-a6ba-a031eb9be76c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.336797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc65b-a11f-4b77-a6ba-a031eb9be76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.354009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcc65b-a11f-4b77-a6ba-a031eb9be76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:46.356617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcc65b-a11f-4b77-a6ba-a031eb9be76c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-20bcc65b-a11f-4b77-a6ba-a031eb9be76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:46.381341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:46.382273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:46.383200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:46.383200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:46.383200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:46.383200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:46.383200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 290/560] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:46.384281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc65b-a11f-4b77-a6ba-a031eb9be76c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.412569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94c7d5-b53d-4988-9416-96824e3afa09 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:46.457271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbea87-03c0-47cd-9df9-2796e26f2213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:46.457921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbea87-03c0-47cd-9df9-2796e26f2213 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.458193 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbea87-03c0-47cd-9df9-2796e26f2213 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.458457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbea87-03c0-47cd-9df9-2796e26f2213 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.470523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbea87-03c0-47cd-9df9-2796e26f2213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-93bbea87-03c0-47cd-9df9-2796e26f2213 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:46.476152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:46.477297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:46.478119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 271/561] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:46.478834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab4a4b-4741-4fc7-b8aa-2e3263c85f21 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.478834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab4a4b-4741-4fc7-b8aa-2e3263c85f21 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.479528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab4a4b-4741-4fc7-b8aa-2e3263c85f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.485977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:46.498218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-99ab4a4b-4741-4fc7-b8aa-2e3263c85f21 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:46.499438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-99ab4a4b-4741-4fc7-b8aa-2e3263c85f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:46.503277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc65b-a11f-4b77-a6ba-a031eb9be76c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:46.526347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:46.539986 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440f68c-e62a-4314-97fb-55ceacc20f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:46.540730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440f68c-e62a-4314-97fb-55ceacc20f2f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.541019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440f68c-e62a-4314-97fb-55ceacc20f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.541294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440f68c-e62a-4314-97fb-55ceacc20f2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.550539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440f68c-e62a-4314-97fb-55ceacc20f2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:46.551974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440f68c-e62a-4314-97fb-55ceacc20f2f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1440f68c-e62a-4314-97fb-55ceacc20f2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:46.564109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:46.565096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:46.566114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 291/562] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:46.566707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440f68c-e62a-4314-97fb-55ceacc20f2f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.578716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 272/563] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:46.579446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab4a4b-4741-4fc7-b8aa-2e3263c85f21 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.691691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440f68c-e62a-4314-97fb-55ceacc20f2f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:46.694811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab4a4b-4741-4fc7-b8aa-2e3263c85f21 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:46.729269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df8ed-1567-46f4-86a4-0fc07cd69f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:46.729889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df8ed-1567-46f4-86a4-0fc07cd69f87 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.730172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df8ed-1567-46f4-86a4-0fc07cd69f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.730454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df8ed-1567-46f4-86a4-0fc07cd69f87 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.731172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207df8ed-1567-46f4-86a4-0fc07cd69f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:46.731483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207df8ed-1567-46f4-86a4-0fc07cd69f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:46.732106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a269cb1-059e-4fbd-954a-96bdf0f80ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:46.732865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207df8ed-1567-46f4-86a4-0fc07cd69f87 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:46.733058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a269cb1-059e-4fbd-954a-96bdf0f80ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.733492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a269cb1-059e-4fbd-954a-96bdf0f80ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.734464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a269cb1-059e-4fbd-954a-96bdf0f80ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.735473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a269cb1-059e-4fbd-954a-96bdf0f80ae0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:46.736003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a269cb1-059e-4fbd-954a-96bdf0f80ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:46.737543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a269cb1-059e-4fbd-954a-96bdf0f80ae0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:46.745445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 292/564] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:46.746454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df8ed-1567-46f4-86a4-0fc07cd69f87 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.747133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 273/565] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:46.748106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a269cb1-059e-4fbd-954a-96bdf0f80ae0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.760306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:46.777645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:46.858357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a269cb1-059e-4fbd-954a-96bdf0f80ae0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:46.865102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df8ed-1567-46f4-86a4-0fc07cd69f87 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:46.898781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4db09-a1e4-4d0a-a36d-0b266313a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:46.899573 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4db09-a1e4-4d0a-a36d-0b266313a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.899856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4db09-a1e4-4d0a-a36d-0b266313a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.900131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4db09-a1e4-4d0a-a36d-0b266313a0f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.901454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0de7fb-a872-410e-8bee-903cc39d54b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:46.902067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0de7fb-a872-410e-8bee-903cc39d54b5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:46.902344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0de7fb-a872-410e-8bee-903cc39d54b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:46.902615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0de7fb-a872-410e-8bee-903cc39d54b5 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:46.903452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0de7fb-a872-410e-8bee-903cc39d54b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:46.903757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0de7fb-a872-410e-8bee-903cc39d54b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:46.905195 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0de7fb-a872-410e-8bee-903cc39d54b5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:46.911109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4db09-a1e4-4d0a-a36d-0b266313a0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-27c4db09-a1e4-4d0a-a36d-0b266313a0f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:46.916455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:46.917369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:46.918248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 274/566] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:46.918955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4db09-a1e4-4d0a-a36d-0b266313a0f1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.927068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 293/567] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:46.927068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0de7fb-a872-410e-8bee-903cc39d54b5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:46.986586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:47.005338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:47.024547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4db09-a1e4-4d0a-a36d-0b266313a0f1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.025972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0de7fb-a872-410e-8bee-903cc39d54b5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.061072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b37df-fb68-4714-817e-75bcfb0838ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.061708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b37df-fb68-4714-817e-75bcfb0838ce None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.061990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b37df-fb68-4714-817e-75bcfb0838ce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.062778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a7ca3-4568-4241-89ee-bdba3094859e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.062930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b37df-fb68-4714-817e-75bcfb0838ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.063443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a7ca3-4568-4241-89ee-bdba3094859e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.063720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a7ca3-4568-4241-89ee-bdba3094859e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.063985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a7ca3-4568-4241-89ee-bdba3094859e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.070556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a7ca3-4568-4241-89ee-bdba3094859e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.072041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a7ca3-4568-4241-89ee-bdba3094859e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.073140 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b37df-fb68-4714-817e-75bcfb0838ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.074567 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b37df-fb68-4714-817e-75bcfb0838ce None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-666a7ca3-4568-4241-89ee-bdba3094859e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:47.083675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:47.084554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:47.085422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:47.085422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:47.085422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:47.085422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:47.085422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:47.085422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:47.085422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:47.085422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:47.085422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 275/568] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:47.086283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2210bab-71f0-4f01-ac9e-1d0ef05a709d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.086558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2210bab-71f0-4f01-ac9e-1d0ef05a709d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.086827 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2210bab-71f0-4f01-ac9e-1d0ef05a709d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.089726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 276/569] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:47.089726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2210bab-71f0-4f01-ac9e-1d0ef05a709d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8e8b37df-fb68-4714-817e-75bcfb0838ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:47.089926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:47.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:47.091939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:47.091939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:47.091939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:47.091939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:47.091939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 294/570] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:47.091939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b37df-fb68-4714-817e-75bcfb0838ce None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.192951 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2210bab-71f0-4f01-ac9e-1d0ef05a709d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.194532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b37df-fb68-4714-817e-75bcfb0838ce None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.212463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:47.228572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c83dd7-588b-4ce9-b4ee-dd1eccca4d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.229208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c83dd7-588b-4ce9-b4ee-dd1eccca4d2e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.229486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c83dd7-588b-4ce9-b4ee-dd1eccca4d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.229760 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c83dd7-588b-4ce9-b4ee-dd1eccca4d2e None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.230486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c83dd7-588b-4ce9-b4ee-dd1eccca4d2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:47.230783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c83dd7-588b-4ce9-b4ee-dd1eccca4d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.232206 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c83dd7-588b-4ce9-b4ee-dd1eccca4d2e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.236301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4eef36-1c60-43aa-bf19-82424f8122cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.237042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eef36-1c60-43aa-bf19-82424f8122cc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.237392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eef36-1c60-43aa-bf19-82424f8122cc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.237739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eef36-1c60-43aa-bf19-82424f8122cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.242229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 277/571] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:47.243065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c83dd7-588b-4ce9-b4ee-dd1eccca4d2e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.249974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4eef36-1c60-43aa-bf19-82424f8122cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.251194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:47.251478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4eef36-1c60-43aa-bf19-82424f8122cc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1f4eef36-1c60-43aa-bf19-82424f8122cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:47.266216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:47.267215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:47.268098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:47.268098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:47.268098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:47.268098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:47.268098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 295/572] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:47.268801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53b9e8-d11a-4f2c-b61a-ffb87e0f5e93 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.268801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53b9e8-d11a-4f2c-b61a-ffb87e0f5e93 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.269096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53b9e8-d11a-4f2c-b61a-ffb87e0f5e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.287050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8a53b9e8-d11a-4f2c-b61a-ffb87e0f5e93 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:47.288235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a53b9e8-d11a-4f2c-b61a-ffb87e0f5e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:47.355612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c83dd7-588b-4ce9-b4ee-dd1eccca4d2e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.362983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 296/573] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:47.363829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53b9e8-d11a-4f2c-b61a-ffb87e0f5e93 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.392546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e993f2-5bdf-4639-b16e-8e4db3add8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.393173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e993f2-5bdf-4639-b16e-8e4db3add8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.393451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e993f2-5bdf-4639-b16e-8e4db3add8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.393719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e993f2-5bdf-4639-b16e-8e4db3add8e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.394492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e993f2-5bdf-4639-b16e-8e4db3add8e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:47.394785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e993f2-5bdf-4639-b16e-8e4db3add8e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.396245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e993f2-5bdf-4639-b16e-8e4db3add8e6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.408659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 278/574] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:47.409764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e993f2-5bdf-4639-b16e-8e4db3add8e6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.473754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:47.474585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:47.477558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53b9e8-d11a-4f2c-b61a-ffb87e0f5e93 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.511024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900adc00-4836-42b9-bd0d-1c0f3388e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.511645 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900adc00-4836-42b9-bd0d-1c0f3388e8bb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.511924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900adc00-4836-42b9-bd0d-1c0f3388e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.512197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900adc00-4836-42b9-bd0d-1c0f3388e8bb None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.512892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900adc00-4836-42b9-bd0d-1c0f3388e8bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:47.513197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900adc00-4836-42b9-bd0d-1c0f3388e8bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.514299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e993f2-5bdf-4639-b16e-8e4db3add8e6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.514564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900adc00-4836-42b9-bd0d-1c0f3388e8bb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.526407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 297/575] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:47.527241 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900adc00-4836-42b9-bd0d-1c0f3388e8bb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.549687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd34096-094a-468c-bd7a-fd6d5511c8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.550341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd34096-094a-468c-bd7a-fd6d5511c8ca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.550621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd34096-094a-468c-bd7a-fd6d5511c8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.550912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd34096-094a-468c-bd7a-fd6d5511c8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.562656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd34096-094a-468c-bd7a-fd6d5511c8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.564155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd34096-094a-468c-bd7a-fd6d5511c8ca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6fd34096-094a-468c-bd7a-fd6d5511c8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:47.579481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:47.580354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:47.581233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:47.581233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:47.581233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:47.581233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:47.581233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 279/576] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:47.581842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd34096-094a-468c-bd7a-fd6d5511c8ca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.635677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900adc00-4836-42b9-bd0d-1c0f3388e8bb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.670685 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb500f85-be42-47d9-b9e2-50619df7404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.671374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb500f85-be42-47d9-b9e2-50619df7404c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.671656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb500f85-be42-47d9-b9e2-50619df7404c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.671929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb500f85-be42-47d9-b9e2-50619df7404c None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.672617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb500f85-be42-47d9-b9e2-50619df7404c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:47.672920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb500f85-be42-47d9-b9e2-50619df7404c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.674285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb500f85-be42-47d9-b9e2-50619df7404c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.681269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd34096-094a-468c-bd7a-fd6d5511c8ca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.685819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 298/577] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:47.686615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb500f85-be42-47d9-b9e2-50619df7404c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.703784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:47.706217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:47.725035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb97709-217c-4606-9cc7-35a55bb934d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.725605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb97709-217c-4606-9cc7-35a55bb934d3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.725881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb97709-217c-4606-9cc7-35a55bb934d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.726150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb97709-217c-4606-9cc7-35a55bb934d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.736359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb97709-217c-4606-9cc7-35a55bb934d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-fbb97709-217c-4606-9cc7-35a55bb934d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:47.741781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:47.742796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:47.743671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 280/578] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:47.744359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb97709-217c-4606-9cc7-35a55bb934d3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.793579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb500f85-be42-47d9-b9e2-50619df7404c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.826980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d946c1-a1ea-4a01-aaac-90dd5c81153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.827600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d946c1-a1ea-4a01-aaac-90dd5c81153d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.828444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d946c1-a1ea-4a01-aaac-90dd5c81153d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.828717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d946c1-a1ea-4a01-aaac-90dd5c81153d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.829506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d946c1-a1ea-4a01-aaac-90dd5c81153d None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=b5bb94b71d1c452a88f1594a6b011ca6) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:47.829814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d946c1-a1ea-4a01-aaac-90dd5c81153d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.831301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d946c1-a1ea-4a01-aaac-90dd5c81153d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.836757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 299/579] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/role_assignments?user.id=b5bb94b71d1c452a88f1594a6b011ca6&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:47.837541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d946c1-a1ea-4a01-aaac-90dd5c81153d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.862706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb97709-217c-4606-9cc7-35a55bb934d3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.904433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8670d5-b2fd-4775-907e-992680ef8781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:47.905131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8670d5-b2fd-4775-907e-992680ef8781 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:47.905412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8670d5-b2fd-4775-907e-992680ef8781 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:47.905712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8670d5-b2fd-4775-907e-992680ef8781 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:47.914317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8670d5-b2fd-4775-907e-992680ef8781 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:47.915832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8670d5-b2fd-4775-907e-992680ef8781 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ca8670d5-b2fd-4775-907e-992680ef8781 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:47.934652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:47.935790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:47.936724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 281/580] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:47.938214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8670d5-b2fd-4775-907e-992680ef8781 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:47.942515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:47.964474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d946c1-a1ea-4a01-aaac-90dd5c81153d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:47.980258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:48.007793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0ca1-ffbb-4531-b3f9-74d55e38c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.008410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0ca1-ffbb-4531-b3f9-74d55e38c746 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.008688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0ca1-ffbb-4531-b3f9-74d55e38c746 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.008945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0ca1-ffbb-4531-b3f9-74d55e38c746 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.009644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de0ca1-ffbb-4531-b3f9-74d55e38c746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:48.009944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de0ca1-ffbb-4531-b3f9-74d55e38c746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.011411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de0ca1-ffbb-4531-b3f9-74d55e38c746 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.027242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 300/581] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:48.028574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0ca1-ffbb-4531-b3f9-74d55e38c746 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.065988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8670d5-b2fd-4775-907e-992680ef8781 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.104614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cff5c-de63-4293-a196-2751e263c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.105252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cff5c-de63-4293-a196-2751e263c349 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.105525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cff5c-de63-4293-a196-2751e263c349 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.105853 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cff5c-de63-4293-a196-2751e263c349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.113761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cff5c-de63-4293-a196-2751e263c349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.115821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cff5c-de63-4293-a196-2751e263c349 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-709cff5c-de63-4293-a196-2751e263c349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:48.128929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:48.130057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:48.131174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:48.131174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:48.131174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:48.131174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:48.131174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:48.131174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:48.131174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:48.131174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:48.136834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 282/582] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:48.136834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cff5c-de63-4293-a196-2751e263c349 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.148585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0ca1-ffbb-4531-b3f9-74d55e38c746 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.189646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77631e0-14a2-42dd-8a8f-6bcc64ad3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.190308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77631e0-14a2-42dd-8a8f-6bcc64ad3b55 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.190593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77631e0-14a2-42dd-8a8f-6bcc64ad3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.190865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77631e0-14a2-42dd-8a8f-6bcc64ad3b55 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.191617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77631e0-14a2-42dd-8a8f-6bcc64ad3b55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:48.191931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77631e0-14a2-42dd-8a8f-6bcc64ad3b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.193314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77631e0-14a2-42dd-8a8f-6bcc64ad3b55 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.206912 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 301/583] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:48.206912 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77631e0-14a2-42dd-8a8f-6bcc64ad3b55 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.208497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:48.240863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:48.247783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cff5c-de63-4293-a196-2751e263c349 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.285217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc490b8-edd7-4837-b70a-6c4f66a98e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.285962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc490b8-edd7-4837-b70a-6c4f66a98e05 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.286247 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc490b8-edd7-4837-b70a-6c4f66a98e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.286523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc490b8-edd7-4837-b70a-6c4f66a98e05 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.287360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc490b8-edd7-4837-b70a-6c4f66a98e05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:48.287670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc490b8-edd7-4837-b70a-6c4f66a98e05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.289235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc490b8-edd7-4837-b70a-6c4f66a98e05 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.309989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 283/584] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:48.311231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc490b8-edd7-4837-b70a-6c4f66a98e05 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.317720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77631e0-14a2-42dd-8a8f-6bcc64ad3b55 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.356486 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e51b9-af0d-418b-9816-d56084879fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.357465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e51b9-af0d-418b-9816-d56084879fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.357980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e51b9-af0d-418b-9816-d56084879fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.358454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e51b9-af0d-418b-9816-d56084879fa1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.370111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e51b9-af0d-418b-9816-d56084879fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.371749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e51b9-af0d-418b-9816-d56084879fa1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7f0e51b9-af0d-418b-9816-d56084879fa1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:48.384838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:48.385837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 302/585] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:48.386771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e51b9-af0d-418b-9816-d56084879fa1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.425225 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc490b8-edd7-4837-b70a-6c4f66a98e05 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.463877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4414476-380e-499b-a761-229b7172e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.464508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4414476-380e-499b-a761-229b7172e827 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.464790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4414476-380e-499b-a761-229b7172e827 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.465058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4414476-380e-499b-a761-229b7172e827 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.465823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4414476-380e-499b-a761-229b7172e827 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:48.466211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4414476-380e-499b-a761-229b7172e827 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.467620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4414476-380e-499b-a761-229b7172e827 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.468819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:48.481196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 284/586] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:48.481935 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4414476-380e-499b-a761-229b7172e827 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.500711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:48.517322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e51b9-af0d-418b-9816-d56084879fa1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.552715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a6938-a975-4996-a091-cc2c33932c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.553364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6938-a975-4996-a091-cc2c33932c04 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.553629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6938-a975-4996-a091-cc2c33932c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.553898 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6938-a975-4996-a091-cc2c33932c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.565623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a6938-a975-4996-a091-cc2c33932c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.567084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a6938-a975-4996-a091-cc2c33932c04 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ef4a6938-a975-4996-a091-cc2c33932c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:48.581522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:48.582433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:48.583703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:48.583703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:48.583703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:48.583703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:48.583703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 303/587] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:48.583703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a6938-a975-4996-a091-cc2c33932c04 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.596026 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4414476-380e-499b-a761-229b7172e827 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.631358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5de99-2888-47e6-882e-730f8af2549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.632000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5de99-2888-47e6-882e-730f8af2549a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.632287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5de99-2888-47e6-882e-730f8af2549a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.632577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5de99-2888-47e6-882e-730f8af2549a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.644478 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5de99-2888-47e6-882e-730f8af2549a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.645948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5de99-2888-47e6-882e-730f8af2549a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9dc5de99-2888-47e6-882e-730f8af2549a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:48.660942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:48.661992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:48.662868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:48.662868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:48.662868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:48.662868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:48.662868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 285/588] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:48.662868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5de99-2888-47e6-882e-730f8af2549a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.701518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a6938-a975-4996-a091-cc2c33932c04 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.719149 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:48.738223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:48.739101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab87142-272f-4ade-a0ac-32d29a39e170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.739749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab87142-272f-4ade-a0ac-32d29a39e170 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.740044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab87142-272f-4ade-a0ac-32d29a39e170 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.740364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab87142-272f-4ade-a0ac-32d29a39e170 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.741212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab87142-272f-4ade-a0ac-32d29a39e170 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:48.741517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab87142-272f-4ade-a0ac-32d29a39e170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.743076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab87142-272f-4ade-a0ac-32d29a39e170 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.761433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 304/589] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:48.762186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab87142-272f-4ade-a0ac-32d29a39e170 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.787147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5de99-2888-47e6-882e-730f8af2549a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.822929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5534fe1-aa6b-4e7f-b9f2-ab31a4cd28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.823602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5534fe1-aa6b-4e7f-b9f2-ab31a4cd28a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.823878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5534fe1-aa6b-4e7f-b9f2-ab31a4cd28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.824146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5534fe1-aa6b-4e7f-b9f2-ab31a4cd28a9 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/0445b52b85994510ad9e66de366ebf4d/roles/acd4741d776c40b8b1f5563ad208b994` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.839955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5534fe1-aa6b-4e7f-b9f2-ab31a4cd28a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=0445b52b85994510ad9e66de366ebf4d, role_id=acd4741d776c40b8b1f5563ad208b994)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.841390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5534fe1-aa6b-4e7f-b9f2-ab31a4cd28a9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.856576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 286/590] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:36:48 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/0445b52b85994510ad9e66de366ebf4d/roles/acd4741d776c40b8b1f5563ad208b994 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:48.857396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5534fe1-aa6b-4e7f-b9f2-ab31a4cd28a9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:48.886713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab87142-272f-4ade-a0ac-32d29a39e170 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:48.932950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154558df-0e15-4f03-bcd1-1fc30d8068e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:48.933595 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154558df-0e15-4f03-bcd1-1fc30d8068e2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:48.933872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154558df-0e15-4f03-bcd1-1fc30d8068e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:48.934141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154558df-0e15-4f03-bcd1-1fc30d8068e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:48.934862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154558df-0e15-4f03-bcd1-1fc30d8068e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:48.935204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154558df-0e15-4f03-bcd1-1fc30d8068e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:48.936712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154558df-0e15-4f03-bcd1-1fc30d8068e2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:48.958687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 305/591] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:48.961571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154558df-0e15-4f03-bcd1-1fc30d8068e2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.008530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:49.022538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5534fe1-aa6b-4e7f-b9f2-ab31a4cd28a9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.041602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:49.068436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ea55-d0fb-4d21-b8f7-a66189ec5385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.069091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ea55-d0fb-4d21-b8f7-a66189ec5385 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.069369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ea55-d0fb-4d21-b8f7-a66189ec5385 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.069638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ea55-d0fb-4d21-b8f7-a66189ec5385 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.070332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54ea55-d0fb-4d21-b8f7-a66189ec5385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:49.070631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54ea55-d0fb-4d21-b8f7-a66189ec5385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.072036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54ea55-d0fb-4d21-b8f7-a66189ec5385 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.085079 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 287/592] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:49.086201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ea55-d0fb-4d21-b8f7-a66189ec5385 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.093327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154558df-0e15-4f03-bcd1-1fc30d8068e2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.132894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ce2d3-94e5-4803-ae3e-8ad3e007b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.133552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ce2d3-94e5-4803-ae3e-8ad3e007b837 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.133819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ce2d3-94e5-4803-ae3e-8ad3e007b837 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.134092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ce2d3-94e5-4803-ae3e-8ad3e007b837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.149324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ce2d3-94e5-4803-ae3e-8ad3e007b837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.151089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ce2d3-94e5-4803-ae3e-8ad3e007b837 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c91ce2d3-94e5-4803-ae3e-8ad3e007b837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:49.171996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:49.172963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:49.173833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:49.173833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:49.173833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:49.173833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:49.178225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 306/593] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:49.179244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ce2d3-94e5-4803-ae3e-8ad3e007b837 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.207608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ea55-d0fb-4d21-b8f7-a66189ec5385 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.245542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc8f29-b93d-42d5-9df6-2c219e2ce87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.246664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc8f29-b93d-42d5-9df6-2c219e2ce87a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.247167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc8f29-b93d-42d5-9df6-2c219e2ce87a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.247624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc8f29-b93d-42d5-9df6-2c219e2ce87a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.257385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc8f29-b93d-42d5-9df6-2c219e2ce87a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.258968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc8f29-b93d-42d5-9df6-2c219e2ce87a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5bdc8f29-b93d-42d5-9df6-2c219e2ce87a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:49.271759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:49.273318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 07:36:49.275121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:49.277571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 288/594] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:49.278515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc8f29-b93d-42d5-9df6-2c219e2ce87a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.281907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:49.298837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ce2d3-94e5-4803-ae3e-8ad3e007b837 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.322035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:49.343238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa857320-e063-48dc-9f33-985392a9d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.343890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa857320-e063-48dc-9f33-985392a9d09e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.344174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa857320-e063-48dc-9f33-985392a9d09e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.344449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa857320-e063-48dc-9f33-985392a9d09e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.352037 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa857320-e063-48dc-9f33-985392a9d09e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.353506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa857320-e063-48dc-9f33-985392a9d09e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-aa857320-e063-48dc-9f33-985392a9d09e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:49.365549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:49.366635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 307/595] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:49.367761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa857320-e063-48dc-9f33-985392a9d09e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.406632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc8f29-b93d-42d5-9df6-2c219e2ce87a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.458030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae4336-840d-47c9-ab57-3a618811069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.458969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae4336-840d-47c9-ab57-3a618811069a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.459436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae4336-840d-47c9-ab57-3a618811069a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.459847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae4336-840d-47c9-ab57-3a618811069a None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.460720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae4336-840d-47c9-ab57-3a618811069a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:49.461166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae4336-840d-47c9-ab57-3a618811069a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.462676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae4336-840d-47c9-ab57-3a618811069a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.480488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 289/596] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:49.481634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae4336-840d-47c9-ab57-3a618811069a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.495619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa857320-e063-48dc-9f33-985392a9d09e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.536684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0afc4-e91f-4f15-ae48-173058eabe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.537533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0afc4-e91f-4f15-ae48-173058eabe28 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.537961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0afc4-e91f-4f15-ae48-173058eabe28 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.538380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0afc4-e91f-4f15-ae48-173058eabe28 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.539376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0afc4-e91f-4f15-ae48-173058eabe28 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:49.539845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0afc4-e91f-4f15-ae48-173058eabe28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.541431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0afc4-e91f-4f15-ae48-173058eabe28 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.565413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 308/597] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jul 27 07:36:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:49.566557 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0afc4-e91f-4f15-ae48-173058eabe28 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.571820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:49.609821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:49.618519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae4336-840d-47c9-ab57-3a618811069a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.659015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4657fc1-d66d-4f6c-9eee-6be1144acebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.659889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4657fc1-d66d-4f6c-9eee-6be1144acebf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.660315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4657fc1-d66d-4f6c-9eee-6be1144acebf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.660826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4657fc1-d66d-4f6c-9eee-6be1144acebf None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.661730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4657fc1-d66d-4f6c-9eee-6be1144acebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:49.662206 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4657fc1-d66d-4f6c-9eee-6be1144acebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.663861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4657fc1-d66d-4f6c-9eee-6be1144acebf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.676813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 290/598] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:49.678067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4657fc1-d66d-4f6c-9eee-6be1144acebf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.684420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0afc4-e91f-4f15-ae48-173058eabe28 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.722587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9da343-ba44-4e80-a35f-89892cf2fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.723263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9da343-ba44-4e80-a35f-89892cf2fe1a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.723521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9da343-ba44-4e80-a35f-89892cf2fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.723795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9da343-ba44-4e80-a35f-89892cf2fe1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.730844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9da343-ba44-4e80-a35f-89892cf2fe1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.732339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9da343-ba44-4e80-a35f-89892cf2fe1a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6f9da343-ba44-4e80-a35f-89892cf2fe1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:49.744682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:49.745824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:49.746767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:49.746767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:49.746767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:49.746767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:49.746767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:49.746767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:49.746767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:49.746767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:49.750811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 309/599] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:49.751681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9da343-ba44-4e80-a35f-89892cf2fe1a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.793133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4657fc1-d66d-4f6c-9eee-6be1144acebf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.818703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:49.831228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79d2a6-72cd-4ab2-a472-03aac1b7ba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.832121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79d2a6-72cd-4ab2-a472-03aac1b7ba06 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.832547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79d2a6-72cd-4ab2-a472-03aac1b7ba06 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.832976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79d2a6-72cd-4ab2-a472-03aac1b7ba06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.844612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79d2a6-72cd-4ab2-a472-03aac1b7ba06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.846408 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79d2a6-72cd-4ab2-a472-03aac1b7ba06 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.861563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9da343-ba44-4e80-a35f-89892cf2fe1a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-4b79d2a6-72cd-4ab2-a472-03aac1b7ba06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:49.863216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:49.864272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:49.865310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:49.865310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:49.865310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:49.865310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:49.871018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 291/600] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:49.872107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79d2a6-72cd-4ab2-a472-03aac1b7ba06 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:49.884809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:49.901359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05324c38-6aa9-4d5e-90d2-ce2f1279f268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:49.902121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05324c38-6aa9-4d5e-90d2-ce2f1279f268 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:49.902412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05324c38-6aa9-4d5e-90d2-ce2f1279f268 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:49.902703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05324c38-6aa9-4d5e-90d2-ce2f1279f268 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/ad7a3c5f6b9645fb8cd2a65cee4f37c9/roles/acd4741d776c40b8b1f5563ad208b994` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:49.918562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05324c38-6aa9-4d5e-90d2-ce2f1279f268 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=ad7a3c5f6b9645fb8cd2a65cee4f37c9, role_id=acd4741d776c40b8b1f5563ad208b994)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:49.920072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05324c38-6aa9-4d5e-90d2-ce2f1279f268 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:49.935290 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 310/601] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:36:49 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/ad7a3c5f6b9645fb8cd2a65cee4f37c9/roles/acd4741d776c40b8b1f5563ad208b994 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:49.936126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05324c38-6aa9-4d5e-90d2-ce2f1279f268 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:50.020677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79d2a6-72cd-4ab2-a472-03aac1b7ba06 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:50.056614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05324c38-6aa9-4d5e-90d2-ce2f1279f268 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:50.072800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6113bb2-9835-42fc-affa-3555852f9c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:50.073740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6113bb2-9835-42fc-affa-3555852f9c7c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:50.074027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6113bb2-9835-42fc-affa-3555852f9c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:50.074302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6113bb2-9835-42fc-affa-3555852f9c7c None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:50.074764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:50.075151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6113bb2-9835-42fc-affa-3555852f9c7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:50.075463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6113bb2-9835-42fc-affa-3555852f9c7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:50.077648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6113bb2-9835-42fc-affa-3555852f9c7c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:50.095166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 292/602] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:50.097524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae318a-7b9e-476f-a300-f14e5ce36d96 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:50.097817 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae318a-7b9e-476f-a300-f14e5ce36d96 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:50.098093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae318a-7b9e-476f-a300-f14e5ce36d96 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:50.102983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 293/603] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:50.104490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae318a-7b9e-476f-a300-f14e5ce36d96 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:50.111422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be1754-3e62-4bd1-9363-64a1c4c5a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:50.112055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be1754-3e62-4bd1-9363-64a1c4c5a8cf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:50.112337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be1754-3e62-4bd1-9363-64a1c4c5a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:50.112610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be1754-3e62-4bd1-9363-64a1c4c5a8cf None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:50.113316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be1754-3e62-4bd1-9363-64a1c4c5a8cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:50.113623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be1754-3e62-4bd1-9363-64a1c4c5a8cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:50.117891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be1754-3e62-4bd1-9363-64a1c4c5a8cf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:50.130242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 311/604] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:50.131839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abd6c2-35f5-48e8-a92b-24e9205c79c0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:50.132343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abd6c2-35f5-48e8-a92b-24e9205c79c0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:50.132807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abd6c2-35f5-48e8-a92b-24e9205c79c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:50.152312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-57abd6c2-35f5-48e8-a92b-24e9205c79c0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:50.153867 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-57abd6c2-35f5-48e8-a92b-24e9205c79c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:50.189831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:50.231397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae318a-7b9e-476f-a300-f14e5ce36d96 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:50.254298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 312/605] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:50.256234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abd6c2-35f5-48e8-a92b-24e9205c79c0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:50.288619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5966ca-5357-4820-8039-7bf91fd20a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:50.289336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5966ca-5357-4820-8039-7bf91fd20a09 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:50.289879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5966ca-5357-4820-8039-7bf91fd20a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:50.290171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5966ca-5357-4820-8039-7bf91fd20a09 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/ae1eae16b54c46e9a92f423094085b70/roles/acd4741d776c40b8b1f5563ad208b994` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:50.310209 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5966ca-5357-4820-8039-7bf91fd20a09 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=ae1eae16b54c46e9a92f423094085b70, role_id=acd4741d776c40b8b1f5563ad208b994)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:50.312953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5966ca-5357-4820-8039-7bf91fd20a09 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:50.334215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 294/606] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:36:50 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/ae1eae16b54c46e9a92f423094085b70/roles/acd4741d776c40b8b1f5563ad208b994 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:50.335611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5966ca-5357-4820-8039-7bf91fd20a09 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:50.387963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abd6c2-35f5-48e8-a92b-24e9205c79c0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:50.392086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:50.461904 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c6ac-81fc-4b3b-be90-1fbc3b1dbfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:50.463013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c6ac-81fc-4b3b-be90-1fbc3b1dbfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:50.463506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c6ac-81fc-4b3b-be90-1fbc3b1dbfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:50.463976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c6ac-81fc-4b3b-be90-1fbc3b1dbfa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:50.478107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5966ca-5357-4820-8039-7bf91fd20a09 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:50.484924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c6ac-81fc-4b3b-be90-1fbc3b1dbfa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:50.486432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c6ac-81fc-4b3b-be90-1fbc3b1dbfa4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d150c6ac-81fc-4b3b-be90-1fbc3b1dbfa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:50.510945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:50.511932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:50.512839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:50.512839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:50.512839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:50.512839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:50.512839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:50.512839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:50.512839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:50.512839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:50.519059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:50.520438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 313/607] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:50.527992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c6ac-81fc-4b3b-be90-1fbc3b1dbfa4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:50.545624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35af481-8c90-47fd-bb12-7b3c79262337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:50.546807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35af481-8c90-47fd-bb12-7b3c79262337 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:50.547123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35af481-8c90-47fd-bb12-7b3c79262337 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:50.547395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35af481-8c90-47fd-bb12-7b3c79262337 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:50.558734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35af481-8c90-47fd-bb12-7b3c79262337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f35af481-8c90-47fd-bb12-7b3c79262337 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:50.563897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:50.564847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:50.565722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 295/608] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:50.571197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35af481-8c90-47fd-bb12-7b3c79262337 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:50.684606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c6ac-81fc-4b3b-be90-1fbc3b1dbfa4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:50.715773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35af481-8c90-47fd-bb12-7b3c79262337 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:50.729929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34ec3-b859-49ae-8c9e-f85bdf368007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:50.731212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34ec3-b859-49ae-8c9e-f85bdf368007 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:50.731675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34ec3-b859-49ae-8c9e-f85bdf368007 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:50.732128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34ec3-b859-49ae-8c9e-f85bdf368007 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:50.733576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34ec3-b859-49ae-8c9e-f85bdf368007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:50.734576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34ec3-b859-49ae-8c9e-f85bdf368007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:50.736677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34ec3-b859-49ae-8c9e-f85bdf368007 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:50.752913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 314/609] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:50.765004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34ec3-b859-49ae-8c9e-f85bdf368007 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:50.783110 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d5cc-b33f-4a9a-9d0a-9f62a1bcbb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:50.783788 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d5cc-b33f-4a9a-9d0a-9f62a1bcbb8d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:50.784063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d5cc-b33f-4a9a-9d0a-9f62a1bcbb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:50.784331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d5cc-b33f-4a9a-9d0a-9f62a1bcbb8d None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:50.785061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02d5cc-b33f-4a9a-9d0a-9f62a1bcbb8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:50.785361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02d5cc-b33f-4a9a-9d0a-9f62a1bcbb8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:50.788848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02d5cc-b33f-4a9a-9d0a-9f62a1bcbb8d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:50.807297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 296/610] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:50.813474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d5cc-b33f-4a9a-9d0a-9f62a1bcbb8d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:50.814635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:50.878911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:50.969949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34ec3-b859-49ae-8c9e-f85bdf368007 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:50.991270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d5cc-b33f-4a9a-9d0a-9f62a1bcbb8d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:51.042378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f893d-064c-4770-9481-512b8911a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:51.043082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f893d-064c-4770-9481-512b8911a2be None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:51.043361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f893d-064c-4770-9481-512b8911a2be None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:51.043634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f893d-064c-4770-9481-512b8911a2be None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/0c65277d89a24081a47a7f928f6c6d28/roles/acd4741d776c40b8b1f5563ad208b994` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:51.056029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f79e7-8cf2-4027-abac-675b46de64d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:51.056695 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f79e7-8cf2-4027-abac-675b46de64d3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:51.056970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f79e7-8cf2-4027-abac-675b46de64d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:51.057236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f79e7-8cf2-4027-abac-675b46de64d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:51.073297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f893d-064c-4770-9481-512b8911a2be None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=0c65277d89a24081a47a7f928f6c6d28, role_id=acd4741d776c40b8b1f5563ad208b994)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:51.074680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f893d-064c-4770-9481-512b8911a2be None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:51.081886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f79e7-8cf2-4027-abac-675b46de64d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:51.081886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f79e7-8cf2-4027-abac-675b46de64d3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f39f79e7-8cf2-4027-abac-675b46de64d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:51.100758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:51.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:51.102606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:51.102606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:51.102606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:51.102606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:51.105046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 297/611] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:51.110935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 315/612] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:36:50 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/0c65277d89a24081a47a7f928f6c6d28/roles/acd4741d776c40b8b1f5563ad208b994 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:36:51.112250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f79e7-8cf2-4027-abac-675b46de64d3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:51.139822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1dcfb-4440-44ed-8bb6-1a55cab10dd0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:51.140699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1dcfb-4440-44ed-8bb6-1a55cab10dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:51.140978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1dcfb-4440-44ed-8bb6-1a55cab10dd0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:51.145984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 316/613] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:51.147996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8545960-3731-4e93-9aaf-4956abe114b0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:51.148281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8545960-3731-4e93-9aaf-4956abe114b0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:51.148553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8545960-3731-4e93-9aaf-4956abe114b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:51.188576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f8545960-3731-4e93-9aaf-4956abe114b0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:51.189876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f8545960-3731-4e93-9aaf-4956abe114b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:51.240916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:51.252923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f79e7-8cf2-4027-abac-675b46de64d3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:51.294612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63d0d-c1e0-4dec-b0e1-314c1e17ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:51.295648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63d0d-c1e0-4dec-b0e1-314c1e17ac2f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:51.296146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63d0d-c1e0-4dec-b0e1-314c1e17ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:51.297141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63d0d-c1e0-4dec-b0e1-314c1e17ac2f None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:51.298752 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb63d0d-c1e0-4dec-b0e1-314c1e17ac2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:51.299296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb63d0d-c1e0-4dec-b0e1-314c1e17ac2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:51.300902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb63d0d-c1e0-4dec-b0e1-314c1e17ac2f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:51.317718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 298/614] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:51.324397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63d0d-c1e0-4dec-b0e1-314c1e17ac2f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:51.365344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 317/615] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:51.389418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8545960-3731-4e93-9aaf-4956abe114b0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:51.394596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:51.474511 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63d0d-c1e0-4dec-b0e1-314c1e17ac2f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:51.521681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a140-96e3-4796-afd1-5a2fe787ec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:51.522072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a140-96e3-4796-afd1-5a2fe787ec05 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:51.522350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a140-96e3-4796-afd1-5a2fe787ec05 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:51.522621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a140-96e3-4796-afd1-5a2fe787ec05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:51.538397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086a140-96e3-4796-afd1-5a2fe787ec05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:51.539877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086a140-96e3-4796-afd1-5a2fe787ec05 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:51.546577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8545960-3731-4e93-9aaf-4956abe114b0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0086a140-96e3-4796-afd1-5a2fe787ec05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:51.563650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:51.564819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:36:51.565962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:51.567289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 299/616] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:36:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:51.570289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a140-96e3-4796-afd1-5a2fe787ec05 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:51.600100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:51.608060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf538c-98cc-4e5f-a797-877f5394f317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:51.609411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf538c-98cc-4e5f-a797-877f5394f317 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:51.609691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf538c-98cc-4e5f-a797-877f5394f317 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:51.609963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf538c-98cc-4e5f-a797-877f5394f317 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:51.633970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf538c-98cc-4e5f-a797-877f5394f317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-83cf538c-98cc-4e5f-a797-877f5394f317 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:51.638943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:51.640288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:51.641336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 318/617] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:51.648154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf538c-98cc-4e5f-a797-877f5394f317 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:51.713435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a140-96e3-4796-afd1-5a2fe787ec05 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:51.751781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46ce1b-a7b5-417c-b5d7-8181372f147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:51.752470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46ce1b-a7b5-417c-b5d7-8181372f147e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:51.752752 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46ce1b-a7b5-417c-b5d7-8181372f147e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:51.753024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46ce1b-a7b5-417c-b5d7-8181372f147e None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:51.753885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46ce1b-a7b5-417c-b5d7-8181372f147e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:51.754194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46ce1b-a7b5-417c-b5d7-8181372f147e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:51.755829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46ce1b-a7b5-417c-b5d7-8181372f147e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:51.779357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 300/618] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 27 07:36:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:51.786407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46ce1b-a7b5-417c-b5d7-8181372f147e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:51.834203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:51.881735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf538c-98cc-4e5f-a797-877f5394f317 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:51.925443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455345d-7e7b-4be4-a0cd-58916d2f4fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:51.926311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455345d-7e7b-4be4-a0cd-58916d2f4fef None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:51.926731 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455345d-7e7b-4be4-a0cd-58916d2f4fef None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:51.927268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455345d-7e7b-4be4-a0cd-58916d2f4fef None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:51.928422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455345d-7e7b-4be4-a0cd-58916d2f4fef None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:51.928889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455345d-7e7b-4be4-a0cd-58916d2f4fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:51.930700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455345d-7e7b-4be4-a0cd-58916d2f4fef None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:51.941292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 319/619] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:51.949641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455345d-7e7b-4be4-a0cd-58916d2f4fef None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:51.959157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:51.993629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46ce1b-a7b5-417c-b5d7-8181372f147e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:52.031430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ed0a8-16c0-4ea8-a7da-ab4393a2c19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:52.032466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ed0a8-16c0-4ea8-a7da-ab4393a2c19f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.032954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ed0a8-16c0-4ea8-a7da-ab4393a2c19f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.033451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ed0a8-16c0-4ea8-a7da-ab4393a2c19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.044296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ed0a8-16c0-4ea8-a7da-ab4393a2c19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:52.046069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ed0a8-16c0-4ea8-a7da-ab4393a2c19f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-677ed0a8-16c0-4ea8-a7da-ab4393a2c19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:52.061353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:52.062482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:52.063387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:52.063387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:52.063387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:52.063387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:52.070679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 301/620] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:52.072176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ed0a8-16c0-4ea8-a7da-ab4393a2c19f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:52.181605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ed0a8-16c0-4ea8-a7da-ab4393a2c19f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:52.186266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455345d-7e7b-4be4-a0cd-58916d2f4fef None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:52.208244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:52.221951 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfae0f-6e81-4166-8bca-50d0953a0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:52.222992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfae0f-6e81-4166-8bca-50d0953a0405 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.223484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfae0f-6e81-4166-8bca-50d0953a0405 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.224217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfae0f-6e81-4166-8bca-50d0953a0405 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.225148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfae0f-6e81-4166-8bca-50d0953a0405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:52.225670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfae0f-6e81-4166-8bca-50d0953a0405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:52.227462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfae0f-6e81-4166-8bca-50d0953a0405 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:52.234191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:52.248705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 302/621] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:52.251157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfae0f-6e81-4166-8bca-50d0953a0405 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:52.263690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0206fb-6988-47ba-976d-cec2a0266901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:52.264304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0206fb-6988-47ba-976d-cec2a0266901 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.264580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0206fb-6988-47ba-976d-cec2a0266901 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.264855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0206fb-6988-47ba-976d-cec2a0266901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.278099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0206fb-6988-47ba-976d-cec2a0266901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:52.279744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0206fb-6988-47ba-976d-cec2a0266901 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8d0206fb-6988-47ba-976d-cec2a0266901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:52.294631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:52.295583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:52.298254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:52.298254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:52.298254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:52.298254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:52.298254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 320/622] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:52.302186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0206fb-6988-47ba-976d-cec2a0266901 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:52.377575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfae0f-6e81-4166-8bca-50d0953a0405 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:52.440751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8b5d4-e5b8-473a-a792-a805232b7bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:52.442460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8b5d4-e5b8-473a-a792-a805232b7bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.442991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8b5d4-e5b8-473a-a792-a805232b7bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.443625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8b5d4-e5b8-473a-a792-a805232b7bd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.444573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0206fb-6988-47ba-976d-cec2a0266901 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:52.453608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8b5d4-e5b8-473a-a792-a805232b7bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:52.455870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8b5d4-e5b8-473a-a792-a805232b7bd0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f5a8b5d4-e5b8-473a-a792-a805232b7bd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:52.476542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:52.477910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:52.479072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:52.479072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:52.479072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:52.479072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:52.479072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:52.479072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:52.479072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:52.479072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:52.485852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 303/623] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:52.485852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b5c82-e696-410a-98de-1c5b62817604 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.485852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b5c82-e696-410a-98de-1c5b62817604 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.485852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b5c82-e696-410a-98de-1c5b62817604 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.485852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 304/624] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:52.489112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b5c82-e696-410a-98de-1c5b62817604 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:52.506032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445408e-91e0-44f6-aebe-f1bd703ce663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:52.507756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445408e-91e0-44f6-aebe-f1bd703ce663 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.508221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445408e-91e0-44f6-aebe-f1bd703ce663 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.508669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445408e-91e0-44f6-aebe-f1bd703ce663 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.509830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445408e-91e0-44f6-aebe-f1bd703ce663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:52.510762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445408e-91e0-44f6-aebe-f1bd703ce663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:52.512603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445408e-91e0-44f6-aebe-f1bd703ce663 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:52.529910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 321/625] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:52.532376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1717832-2050-43e2-b893-4d4f1aafadb5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.532856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1717832-2050-43e2-b893-4d4f1aafadb5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.533285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1717832-2050-43e2-b893-4d4f1aafadb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.546377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:52.555263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d1717832-2050-43e2-b893-4d4f1aafadb5 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:52.556944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d1717832-2050-43e2-b893-4d4f1aafadb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:52.596296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:52.619609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b5c82-e696-410a-98de-1c5b62817604 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:52.648022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 322/626] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:52.648983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1717832-2050-43e2-b893-4d4f1aafadb5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:52.684312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d5a53-ca50-425d-843b-d8e473204668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:52.685122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d5a53-ca50-425d-843b-d8e473204668 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.685505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d5a53-ca50-425d-843b-d8e473204668 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.685879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d5a53-ca50-425d-843b-d8e473204668 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.687468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d5a53-ca50-425d-843b-d8e473204668 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:52.687823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d5a53-ca50-425d-843b-d8e473204668 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:52.689430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d5a53-ca50-425d-843b-d8e473204668 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:52.703378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 305/627] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:52.704435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d5a53-ca50-425d-843b-d8e473204668 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:52.775262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1717832-2050-43e2-b893-4d4f1aafadb5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:52.812336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d5a53-ca50-425d-843b-d8e473204668 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:52.814318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:52.819880 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ec9df-6e08-477c-831a-41bd78ba18c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:52.820521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ec9df-6e08-477c-831a-41bd78ba18c3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.821243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ec9df-6e08-477c-831a-41bd78ba18c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.821581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ec9df-6e08-477c-831a-41bd78ba18c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.830234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ec9df-6e08-477c-831a-41bd78ba18c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:52.831707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ec9df-6e08-477c-831a-41bd78ba18c3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c56ec9df-6e08-477c-831a-41bd78ba18c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:52.843508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:52.844925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 323/628] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 27 07:36:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:52.845903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ec9df-6e08-477c-831a-41bd78ba18c3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:52.855259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da91569-5ca0-4939-8c1a-e76b1f35e1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:52.855995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da91569-5ca0-4939-8c1a-e76b1f35e1bd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.856349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da91569-5ca0-4939-8c1a-e76b1f35e1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.856693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da91569-5ca0-4939-8c1a-e76b1f35e1bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.869519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da91569-5ca0-4939-8c1a-e76b1f35e1bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2da91569-5ca0-4939-8c1a-e76b1f35e1bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:52.875023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:52.875942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:52.876772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 306/629] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:52.877465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75134aa-3ab2-4f6c-b313-9d0bddcf83a3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:52.878502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75134aa-3ab2-4f6c-b313-9d0bddcf83a3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:52.878502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75134aa-3ab2-4f6c-b313-9d0bddcf83a3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:52.879395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 307/630] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:52.880086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75134aa-3ab2-4f6c-b313-9d0bddcf83a3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:52.888192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:52.976935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ec9df-6e08-477c-831a-41bd78ba18c3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:52.989954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75134aa-3ab2-4f6c-b313-9d0bddcf83a3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:53.017632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd8e05-d48e-4fda-b3bf-ab02061b8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:53.018317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd8e05-d48e-4fda-b3bf-ab02061b8719 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.018666 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd8e05-d48e-4fda-b3bf-ab02061b8719 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.018971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd8e05-d48e-4fda-b3bf-ab02061b8719 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/b5bb94b71d1c452a88f1594a6b011ca6/roles/acd4741d776c40b8b1f5563ad208b994` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.030091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141053cd-06cb-4b65-b35d-3f458390b652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:53.031332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141053cd-06cb-4b65-b35d-3f458390b652 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.031615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141053cd-06cb-4b65-b35d-3f458390b652 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.031879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141053cd-06cb-4b65-b35d-3f458390b652 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.032680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141053cd-06cb-4b65-b35d-3f458390b652 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:53.032981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141053cd-06cb-4b65-b35d-3f458390b652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:53.034398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141053cd-06cb-4b65-b35d-3f458390b652 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:53.035639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd8e05-d48e-4fda-b3bf-ab02061b8719 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=b5bb94b71d1c452a88f1594a6b011ca6, role_id=acd4741d776c40b8b1f5563ad208b994)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:53.037608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd8e05-d48e-4fda-b3bf-ab02061b8719 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:53.050701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 324/631] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:36:52 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/b5bb94b71d1c452a88f1594a6b011ca6/roles/acd4741d776c40b8b1f5563ad208b994 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:36:53.051855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd8e05-d48e-4fda-b3bf-ab02061b8719 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:53.064223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 308/632] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 27 07:36:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:53.065667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412ecb1-9f89-43bf-b28c-e619d5386e8c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.065954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412ecb1-9f89-43bf-b28c-e619d5386e8c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.066222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412ecb1-9f89-43bf-b28c-e619d5386e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.086748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5412ecb1-9f89-43bf-b28c-e619d5386e8c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:53.088029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5412ecb1-9f89-43bf-b28c-e619d5386e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:53.108241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:53.174321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:53.177245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 309/633] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:53.178698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412ecb1-9f89-43bf-b28c-e619d5386e8c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:53.226292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd8e05-d48e-4fda-b3bf-ab02061b8719 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:53.275315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1e106-c473-4f8e-8969-0bee5eee0042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:53.275315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1e106-c473-4f8e-8969-0bee5eee0042 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.275315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1e106-c473-4f8e-8969-0bee5eee0042 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.275621 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1e106-c473-4f8e-8969-0bee5eee0042 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.276169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1e106-c473-4f8e-8969-0bee5eee0042 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:53.276469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1e106-c473-4f8e-8969-0bee5eee0042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:53.278772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1e106-c473-4f8e-8969-0bee5eee0042 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:53.287838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 325/634] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:53.290430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1e106-c473-4f8e-8969-0bee5eee0042 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:53.320958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412ecb1-9f89-43bf-b28c-e619d5386e8c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:53.358994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74390cb-dbbb-4f93-9b81-16498a96fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:53.359498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74390cb-dbbb-4f93-9b81-16498a96fa09 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.359784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74390cb-dbbb-4f93-9b81-16498a96fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.360057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74390cb-dbbb-4f93-9b81-16498a96fa09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.381197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:53.411102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1e106-c473-4f8e-8969-0bee5eee0042 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:53.435271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74390cb-dbbb-4f93-9b81-16498a96fa09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:53.437254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74390cb-dbbb-4f93-9b81-16498a96fa09 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:53.457454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5945c11-cb40-4416-8f21-fca7becf35cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:53.458227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5945c11-cb40-4416-8f21-fca7becf35cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.458600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5945c11-cb40-4416-8f21-fca7becf35cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.458966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5945c11-cb40-4416-8f21-fca7becf35cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.474112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:53.477638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5945c11-cb40-4416-8f21-fca7becf35cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e5945c11-cb40-4416-8f21-fca7becf35cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:53.483318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:53.485045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:53.486159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:53.493571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 326/635] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:53.493571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5945c11-cb40-4416-8f21-fca7becf35cd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:53.576048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 310/636] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:53.577152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74390cb-dbbb-4f93-9b81-16498a96fa09 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:53.629251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5945c11-cb40-4416-8f21-fca7becf35cd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:53.637862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:53.672742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39431e-0f0a-4d66-8ed1-a4fe3bb09af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:53.673550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39431e-0f0a-4d66-8ed1-a4fe3bb09af0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.673837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39431e-0f0a-4d66-8ed1-a4fe3bb09af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.674408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39431e-0f0a-4d66-8ed1-a4fe3bb09af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.687491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39431e-0f0a-4d66-8ed1-a4fe3bb09af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:53.688947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39431e-0f0a-4d66-8ed1-a4fe3bb09af0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:53.689264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74390cb-dbbb-4f93-9b81-16498a96fa09 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-cc39431e-0f0a-4d66-8ed1-a4fe3bb09af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:53.704122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:53.705136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:53.706024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:53.706024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:53.706024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:53.706024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:53.706024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 327/637] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:53.706995 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39431e-0f0a-4d66-8ed1-a4fe3bb09af0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:53.730037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788937ae-4ea6-4831-b0ad-39ec572658af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:53.730656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788937ae-4ea6-4831-b0ad-39ec572658af None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.730981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788937ae-4ea6-4831-b0ad-39ec572658af None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.731251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788937ae-4ea6-4831-b0ad-39ec572658af None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.731972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788937ae-4ea6-4831-b0ad-39ec572658af None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:53.732271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788937ae-4ea6-4831-b0ad-39ec572658af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:53.733616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788937ae-4ea6-4831-b0ad-39ec572658af None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:53.742258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 311/638] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:53.743514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ae18e-060e-46be-903b-9dcabf68614d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.743798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ae18e-060e-46be-903b-9dcabf68614d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.744066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ae18e-060e-46be-903b-9dcabf68614d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.749123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 312/639] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:53.749123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ae18e-060e-46be-903b-9dcabf68614d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:53.777833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:53.834960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39431e-0f0a-4d66-8ed1-a4fe3bb09af0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:53.858624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ae18e-060e-46be-903b-9dcabf68614d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:53.875465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:53.878246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55d92a-7e60-4263-82ea-bd4d4d0fad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:53.879279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55d92a-7e60-4263-82ea-bd4d4d0fad98 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.879722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55d92a-7e60-4263-82ea-bd4d4d0fad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.880203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55d92a-7e60-4263-82ea-bd4d4d0fad98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.896214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55d92a-7e60-4263-82ea-bd4d4d0fad98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:53.897896 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55d92a-7e60-4263-82ea-bd4d4d0fad98 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:53.906235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c770097-3775-4815-bb6b-a6c2aa369ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:53.906698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c770097-3775-4815-bb6b-a6c2aa369ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.907172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c770097-3775-4815-bb6b-a6c2aa369ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.907587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c770097-3775-4815-bb6b-a6c2aa369ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.908669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c770097-3775-4815-bb6b-a6c2aa369ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:53.909139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c770097-3775-4815-bb6b-a6c2aa369ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:53.911324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c770097-3775-4815-bb6b-a6c2aa369ab6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3e55d92a-7e60-4263-82ea-bd4d4d0fad98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:53.914469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:53.915458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:53.916527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:53.916527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:53.916527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:53.916527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:53.918380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 328/640] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:53.919395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55d92a-7e60-4263-82ea-bd4d4d0fad98 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:53.927920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 313/641] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:53.929226 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb9de5-8d20-4c85-920d-ced77b611efa None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:53.929508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb9de5-8d20-4c85-920d-ced77b611efa None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:53.929778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb9de5-8d20-4c85-920d-ced77b611efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:53.951829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a4fb9de5-8d20-4c85-920d-ced77b611efa None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:53.953238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a4fb9de5-8d20-4c85-920d-ced77b611efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:54.034922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 314/642] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:54.034922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb9de5-8d20-4c85-920d-ced77b611efa None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.052155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55d92a-7e60-4263-82ea-bd4d4d0fad98 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.057063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:54.098964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca5e8b-c3b0-4067-b23a-5ba71e53f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.099797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca5e8b-c3b0-4067-b23a-5ba71e53f942 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.100193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca5e8b-c3b0-4067-b23a-5ba71e53f942 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.100470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca5e8b-c3b0-4067-b23a-5ba71e53f942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.114709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca5e8b-c3b0-4067-b23a-5ba71e53f942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:54.116215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca5e8b-c3b0-4067-b23a-5ba71e53f942 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-29ca5e8b-c3b0-4067-b23a-5ba71e53f942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:54.133381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:54.134381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:54.135301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:54.135301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:54.135301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:54.135301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:54.139239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 329/643] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:54.140139 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca5e8b-c3b0-4067-b23a-5ba71e53f942 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.148530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb9de5-8d20-4c85-920d-ced77b611efa None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.150386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:54.187213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42896e-cde4-4e04-8956-f00d006631e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.187846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42896e-cde4-4e04-8956-f00d006631e7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.188123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42896e-cde4-4e04-8956-f00d006631e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.188387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42896e-cde4-4e04-8956-f00d006631e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.189083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42896e-cde4-4e04-8956-f00d006631e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:54.189462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42896e-cde4-4e04-8956-f00d006631e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:54.190736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42896e-cde4-4e04-8956-f00d006631e7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:54.213628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 315/644] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:54.213628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42896e-cde4-4e04-8956-f00d006631e7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.264151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca5e8b-c3b0-4067-b23a-5ba71e53f942 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.301438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4542e-d31a-4dfd-aa0e-c5c7a86f35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.302083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4542e-d31a-4dfd-aa0e-c5c7a86f35d1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.302364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4542e-d31a-4dfd-aa0e-c5c7a86f35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.302638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4542e-d31a-4dfd-aa0e-c5c7a86f35d1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.310528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4542e-d31a-4dfd-aa0e-c5c7a86f35d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:54.312619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4542e-d31a-4dfd-aa0e-c5c7a86f35d1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-48f4542e-d31a-4dfd-aa0e-c5c7a86f35d1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:54.324256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:54.325247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 330/645] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:54.326344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4542e-d31a-4dfd-aa0e-c5c7a86f35d1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.333547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42896e-cde4-4e04-8956-f00d006631e7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.348685 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:54.375253 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aed9e-c633-40f2-8acb-f8fe7f46ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.375831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aed9e-c633-40f2-8acb-f8fe7f46ea53 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.376425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aed9e-c633-40f2-8acb-f8fe7f46ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.376708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aed9e-c633-40f2-8acb-f8fe7f46ea53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.388376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91aed9e-c633-40f2-8acb-f8fe7f46ea53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f91aed9e-c633-40f2-8acb-f8fe7f46ea53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:54.393821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:54.394786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:54.395668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:54.399909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 316/646] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:54.400591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aed9e-c633-40f2-8acb-f8fe7f46ea53 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.430625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:54.449012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4542e-d31a-4dfd-aa0e-c5c7a86f35d1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.489814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680bf20-4b80-4286-b13b-f75762c93ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.490873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680bf20-4b80-4286-b13b-f75762c93ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.491379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680bf20-4b80-4286-b13b-f75762c93ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.491871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680bf20-4b80-4286-b13b-f75762c93ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.493150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680bf20-4b80-4286-b13b-f75762c93ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:54.493640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680bf20-4b80-4286-b13b-f75762c93ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:54.496149 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680bf20-4b80-4286-b13b-f75762c93ba0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:54.508588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 331/647] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:54.509403 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680bf20-4b80-4286-b13b-f75762c93ba0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.517235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aed9e-c633-40f2-8acb-f8fe7f46ea53 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.554772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2caab3-b7bc-4472-ab24-93f934a2ec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.555481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2caab3-b7bc-4472-ab24-93f934a2ec8d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.555763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2caab3-b7bc-4472-ab24-93f934a2ec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.556037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2caab3-b7bc-4472-ab24-93f934a2ec8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.563755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2caab3-b7bc-4472-ab24-93f934a2ec8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:54.565225 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2caab3-b7bc-4472-ab24-93f934a2ec8d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2c2caab3-b7bc-4472-ab24-93f934a2ec8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:54.577001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:54.578542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:54.579492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:54.579492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:54.579492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:54.579492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:54.579492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:54.579492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:54.579492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:54.579492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:54.583458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 317/648] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:54.584335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2caab3-b7bc-4472-ab24-93f934a2ec8d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.592620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:54.618338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680bf20-4b80-4286-b13b-f75762c93ba0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.656199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a93f-dc98-4d46-91fa-7bc18948b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.656701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a93f-dc98-4d46-91fa-7bc18948b817 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.656983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a93f-dc98-4d46-91fa-7bc18948b817 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.657259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a93f-dc98-4d46-91fa-7bc18948b817 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.658041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8a93f-dc98-4d46-91fa-7bc18948b817 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:54.658341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8a93f-dc98-4d46-91fa-7bc18948b817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:54.659805 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8a93f-dc98-4d46-91fa-7bc18948b817 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:54.673834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:54.678708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 332/649] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:54.679563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a93f-dc98-4d46-91fa-7bc18948b817 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.698347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2caab3-b7bc-4472-ab24-93f934a2ec8d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.733026 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba838a0-3570-4983-b2ec-5bee9dee34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.734223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba838a0-3570-4983-b2ec-5bee9dee34c3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.734497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba838a0-3570-4983-b2ec-5bee9dee34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.734767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba838a0-3570-4983-b2ec-5bee9dee34c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.735530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba838a0-3570-4983-b2ec-5bee9dee34c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:54.735837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba838a0-3570-4983-b2ec-5bee9dee34c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:54.737211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba838a0-3570-4983-b2ec-5bee9dee34c3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:54.749949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 318/650] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:54.749949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba838a0-3570-4983-b2ec-5bee9dee34c3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.797902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a93f-dc98-4d46-91fa-7bc18948b817 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.835616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f73233-acbf-4b8b-a6a8-53ad84aedbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.836262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73233-acbf-4b8b-a6a8-53ad84aedbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.836542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73233-acbf-4b8b-a6a8-53ad84aedbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.836819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73233-acbf-4b8b-a6a8-53ad84aedbf3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.839060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:54.846823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f73233-acbf-4b8b-a6a8-53ad84aedbf3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:54.849155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f73233-acbf-4b8b-a6a8-53ad84aedbf3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:54.850100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba838a0-3570-4983-b2ec-5bee9dee34c3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d7f73233-acbf-4b8b-a6a8-53ad84aedbf3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:54.864124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:54.865089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 333/651] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:54.866060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f73233-acbf-4b8b-a6a8-53ad84aedbf3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.891477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d165e62-8e08-4fba-a45a-d8f4ccf9a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:54.892360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d165e62-8e08-4fba-a45a-d8f4ccf9a28e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:54.892482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d165e62-8e08-4fba-a45a-d8f4ccf9a28e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:54.892684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d165e62-8e08-4fba-a45a-d8f4ccf9a28e None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:54.893438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d165e62-8e08-4fba-a45a-d8f4ccf9a28e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:54.893745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d165e62-8e08-4fba-a45a-d8f4ccf9a28e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:54.895310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d165e62-8e08-4fba-a45a-d8f4ccf9a28e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:54.909161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 319/652] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:54.909913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d165e62-8e08-4fba-a45a-d8f4ccf9a28e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:54.914367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:54.977894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f73233-acbf-4b8b-a6a8-53ad84aedbf3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:55.012467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6996fd-7460-4dcd-a2eb-a3f23a47c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:55.013089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6996fd-7460-4dcd-a2eb-a3f23a47c718 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.013376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6996fd-7460-4dcd-a2eb-a3f23a47c718 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.013648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6996fd-7460-4dcd-a2eb-a3f23a47c718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.016430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d165e62-8e08-4fba-a45a-d8f4ccf9a28e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:55.054989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9ce94-ad95-4d1c-bd23-18cf43f2e286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:55.055638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ce94-ad95-4d1c-bd23-18cf43f2e286 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.055917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ce94-ad95-4d1c-bd23-18cf43f2e286 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.056190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ce94-ad95-4d1c-bd23-18cf43f2e286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.067259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9ce94-ad95-4d1c-bd23-18cf43f2e286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:55.068766 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9ce94-ad95-4d1c-bd23-18cf43f2e286 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:55.080857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5cd9ce94-ad95-4d1c-bd23-18cf43f2e286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:55.085020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:55.085884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:55.086772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:55.086772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:55.086772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:55.086772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:55.086772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 320/653] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:55.087098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9ce94-ad95-4d1c-bd23-18cf43f2e286 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:55.094604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6996fd-7460-4dcd-a2eb-a3f23a47c718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:55.096114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6996fd-7460-4dcd-a2eb-a3f23a47c718 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:55.144158 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:55.189690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9ce94-ad95-4d1c-bd23-18cf43f2e286 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:55.201324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 334/654] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:55.202163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6996fd-7460-4dcd-a2eb-a3f23a47c718 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:55.225196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fab53-5a75-4a20-802f-6dcce81346ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:55.225814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fab53-5a75-4a20-802f-6dcce81346ca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.226089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fab53-5a75-4a20-802f-6dcce81346ca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.226353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fab53-5a75-4a20-802f-6dcce81346ca None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.227171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fab53-5a75-4a20-802f-6dcce81346ca None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:55.227473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fab53-5a75-4a20-802f-6dcce81346ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:55.228890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fab53-5a75-4a20-802f-6dcce81346ca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:55.246059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 321/655] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 27 07:36:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:55.246871 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fab53-5a75-4a20-802f-6dcce81346ca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:55.298586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:55.305552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6996fd-7460-4dcd-a2eb-a3f23a47c718 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:55.339920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99278e3-8d45-46be-b217-67410a48efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:55.340530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99278e3-8d45-46be-b217-67410a48efae None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.340810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99278e3-8d45-46be-b217-67410a48efae None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.341081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99278e3-8d45-46be-b217-67410a48efae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.341872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99278e3-8d45-46be-b217-67410a48efae None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=0445b52b85994510ad9e66de366ebf4d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:55.342175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99278e3-8d45-46be-b217-67410a48efae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:55.344185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99278e3-8d45-46be-b217-67410a48efae None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:55.350396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 335/656] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:55 2022] GET /identity/v3/role_assignments?user.id=0445b52b85994510ad9e66de366ebf4d&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:55.351056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fab53-5a75-4a20-802f-6dcce81346ca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:55.351663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70db60-d2eb-4873-9362-2e3b9f17efdd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.351948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70db60-d2eb-4873-9362-2e3b9f17efdd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.352220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70db60-d2eb-4873-9362-2e3b9f17efdd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.353449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 336/657] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:55.354154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70db60-d2eb-4873-9362-2e3b9f17efdd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:55.383125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:55.408508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad965505-f4c9-4304-93eb-91e8a478fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:55.409273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad965505-f4c9-4304-93eb-91e8a478fb60 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.409610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad965505-f4c9-4304-93eb-91e8a478fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.410230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad965505-f4c9-4304-93eb-91e8a478fb60 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.410608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad965505-f4c9-4304-93eb-91e8a478fb60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:55.410968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad965505-f4c9-4304-93eb-91e8a478fb60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:55.412359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad965505-f4c9-4304-93eb-91e8a478fb60 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:55.431444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 322/658] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:55.432545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad965505-f4c9-4304-93eb-91e8a478fb60 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:55.487752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70db60-d2eb-4873-9362-2e3b9f17efdd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:55.528516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c25c26-a28e-4710-aeed-14aac83dae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:55.529167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c25c26-a28e-4710-aeed-14aac83dae5e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.531126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c25c26-a28e-4710-aeed-14aac83dae5e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.531126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c25c26-a28e-4710-aeed-14aac83dae5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.542112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c25c26-a28e-4710-aeed-14aac83dae5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:55.543881 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c25c26-a28e-4710-aeed-14aac83dae5e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:55.551266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad965505-f4c9-4304-93eb-91e8a478fb60 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-75c25c26-a28e-4710-aeed-14aac83dae5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:55.559191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:55.560111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:55.561011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:55.561011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:55.561011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:55.561011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:55.561011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 337/659] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:55.566861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce713999-a424-42ef-94e5-7068533b7d62 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.566861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce713999-a424-42ef-94e5-7068533b7d62 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.566861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce713999-a424-42ef-94e5-7068533b7d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.584642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ce713999-a424-42ef-94e5-7068533b7d62 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:55.585849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ce713999-a424-42ef-94e5-7068533b7d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:55.588894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:55.596235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8bc70-61bc-4fbf-a5b4-d8f58fce7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:55.597356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8bc70-61bc-4fbf-a5b4-d8f58fce7aec None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.597629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8bc70-61bc-4fbf-a5b4-d8f58fce7aec None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.597900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8bc70-61bc-4fbf-a5b4-d8f58fce7aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.651051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:55.670072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 338/660] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:55.671818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce713999-a424-42ef-94e5-7068533b7d62 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:55.688391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8bc70-61bc-4fbf-a5b4-d8f58fce7aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:55.689973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8bc70-61bc-4fbf-a5b4-d8f58fce7aec None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:55.794916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce713999-a424-42ef-94e5-7068533b7d62 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:55.796532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 323/661] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:55.799810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8bc70-61bc-4fbf-a5b4-d8f58fce7aec None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:55.833301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629d49-c29c-4a64-8e2f-57b67ea82fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:55.833940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629d49-c29c-4a64-8e2f-57b67ea82fcd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.834217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629d49-c29c-4a64-8e2f-57b67ea82fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.834499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629d49-c29c-4a64-8e2f-57b67ea82fcd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.841804 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629d49-c29c-4a64-8e2f-57b67ea82fcd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:55.843319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629d49-c29c-4a64-8e2f-57b67ea82fcd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:55.845969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-11629d49-c29c-4a64-8e2f-57b67ea82fcd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:55.856828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:55.858004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 07:36:55.859614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:55.865641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 339/662] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:55.865641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629d49-c29c-4a64-8e2f-57b67ea82fcd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:55.883238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:55.912727 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8bc70-61bc-4fbf-a5b4-d8f58fce7aec None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:55.949298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e4eee-3346-476d-b9b0-ecb4eb2f0cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:55.949924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e4eee-3346-476d-b9b0-ecb4eb2f0cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:55.950202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e4eee-3346-476d-b9b0-ecb4eb2f0cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:55.950472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e4eee-3346-476d-b9b0-ecb4eb2f0cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:55.951255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e4eee-3346-476d-b9b0-ecb4eb2f0cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:55.952008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e4eee-3346-476d-b9b0-ecb4eb2f0cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:55.954312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e4eee-3346-476d-b9b0-ecb4eb2f0cf7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:55.969712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 324/663] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:55.970548 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e4eee-3346-476d-b9b0-ecb4eb2f0cf7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:55.986841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629d49-c29c-4a64-8e2f-57b67ea82fcd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.024344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0bfae-41da-40fe-bb41-b4b771c3b48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.024978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0bfae-41da-40fe-bb41-b4b771c3b48f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.025277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0bfae-41da-40fe-bb41-b4b771c3b48f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.025838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0bfae-41da-40fe-bb41-b4b771c3b48f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.037122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0bfae-41da-40fe-bb41-b4b771c3b48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9db0bfae-41da-40fe-bb41-b4b771c3b48f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:56.042426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:56.043677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 340/664] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:36:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:56.044609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0bfae-41da-40fe-bb41-b4b771c3b48f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.082204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e4eee-3346-476d-b9b0-ecb4eb2f0cf7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.113030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:56.118123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827e8c4-051f-4501-9cf4-5e8b7f83c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.118920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827e8c4-051f-4501-9cf4-5e8b7f83c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.119297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827e8c4-051f-4501-9cf4-5e8b7f83c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.119668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827e8c4-051f-4501-9cf4-5e8b7f83c9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.121822 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:56.131520 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827e8c4-051f-4501-9cf4-5e8b7f83c9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:56.133125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827e8c4-051f-4501-9cf4-5e8b7f83c9a7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9827e8c4-051f-4501-9cf4-5e8b7f83c9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:56.148054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:56.149171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:56.150259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:56.150259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:56.150259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:56.150259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:56.156169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 325/665] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:56.156169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827e8c4-051f-4501-9cf4-5e8b7f83c9a7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.167124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0bfae-41da-40fe-bb41-b4b771c3b48f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.203735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776b526-9539-4590-9f52-afdeb390b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.204847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776b526-9539-4590-9f52-afdeb390b125 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.205195 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776b526-9539-4590-9f52-afdeb390b125 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.205477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776b526-9539-4590-9f52-afdeb390b125 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.206276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776b526-9539-4590-9f52-afdeb390b125 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:56.206579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776b526-9539-4590-9f52-afdeb390b125 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:56.208068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776b526-9539-4590-9f52-afdeb390b125 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:56.231969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 341/666] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:56.231969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776b526-9539-4590-9f52-afdeb390b125 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.263885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827e8c4-051f-4501-9cf4-5e8b7f83c9a7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.297785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dece3f-4819-446c-b0d4-12ef1d378de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.298532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dece3f-4819-446c-b0d4-12ef1d378de4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.298900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dece3f-4819-446c-b0d4-12ef1d378de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.299217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dece3f-4819-446c-b0d4-12ef1d378de4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.306294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dece3f-4819-446c-b0d4-12ef1d378de4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:56.307767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dece3f-4819-446c-b0d4-12ef1d378de4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e9dece3f-4819-446c-b0d4-12ef1d378de4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:56.319811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:56.320738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:56.321635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:56.321635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:56.321635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:56.321635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:56.321635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:56.321635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:56.321635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:56.321635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:56.321635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 326/667] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:56.322135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dece3f-4819-446c-b0d4-12ef1d378de4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.336127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776b526-9539-4590-9f52-afdeb390b125 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.358225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:56.380267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:56.382354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fbe2e-e3d3-437f-965b-cd39ed1e6356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.383080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbe2e-e3d3-437f-965b-cd39ed1e6356 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.383451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbe2e-e3d3-437f-965b-cd39ed1e6356 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.383976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbe2e-e3d3-437f-965b-cd39ed1e6356 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.384701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fbe2e-e3d3-437f-965b-cd39ed1e6356 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:56.385005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fbe2e-e3d3-437f-965b-cd39ed1e6356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:56.386371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fbe2e-e3d3-437f-965b-cd39ed1e6356 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:56.399298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 342/668] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:56.399950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fbe2e-e3d3-437f-965b-cd39ed1e6356 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.449667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dece3f-4819-446c-b0d4-12ef1d378de4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.486812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a77b9-6e19-4c78-8d41-e2ae95365db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.487758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a77b9-6e19-4c78-8d41-e2ae95365db8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.488191 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a77b9-6e19-4c78-8d41-e2ae95365db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.488466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a77b9-6e19-4c78-8d41-e2ae95365db8 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.489161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a77b9-6e19-4c78-8d41-e2ae95365db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:56.489465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a77b9-6e19-4c78-8d41-e2ae95365db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:56.490824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a77b9-6e19-4c78-8d41-e2ae95365db8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:56.510099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 327/669] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:56.510099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a77b9-6e19-4c78-8d41-e2ae95365db8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.511202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fbe2e-e3d3-437f-965b-cd39ed1e6356 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.549408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1ecc8-4bc1-4e6c-b236-b7bff946851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.550045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ecc8-4bc1-4e6c-b236-b7bff946851c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.550332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ecc8-4bc1-4e6c-b236-b7bff946851c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.550601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ecc8-4bc1-4e6c-b236-b7bff946851c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.615299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:56.621380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a77b9-6e19-4c78-8d41-e2ae95365db8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.632005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:56.637861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1ecc8-4bc1-4e6c-b236-b7bff946851c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:56.639353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1ecc8-4bc1-4e6c-b236-b7bff946851c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:56.667239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d20a6-4a80-4d9f-af46-ba49796059f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.667870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d20a6-4a80-4d9f-af46-ba49796059f9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.668153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d20a6-4a80-4d9f-af46-ba49796059f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.668425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d20a6-4a80-4d9f-af46-ba49796059f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.669184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d20a6-4a80-4d9f-af46-ba49796059f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:56.669494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d20a6-4a80-4d9f-af46-ba49796059f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:56.670946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d20a6-4a80-4d9f-af46-ba49796059f9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:56.689022 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 328/670] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:56.689022 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d20a6-4a80-4d9f-af46-ba49796059f9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.755592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 343/671] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:56.755592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1ecc8-4bc1-4e6c-b236-b7bff946851c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.799341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d20a6-4a80-4d9f-af46-ba49796059f9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.837050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c3c90-decb-4756-af0a-be9083cc12f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.837717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c3c90-decb-4756-af0a-be9083cc12f6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.838014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c3c90-decb-4756-af0a-be9083cc12f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.838286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c3c90-decb-4756-af0a-be9083cc12f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.846414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:56.851157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c3c90-decb-4756-af0a-be9083cc12f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:56.852857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c3c90-decb-4756-af0a-be9083cc12f6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-020c3c90-decb-4756-af0a-be9083cc12f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:56.868358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:56.869267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:56.870146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:56.870146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:56.870146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:56.870146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:56.870389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1ecc8-4bc1-4e6c-b236-b7bff946851c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:56.871731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 329/672] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:56.872673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c3c90-decb-4756-af0a-be9083cc12f6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.895213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:56.917462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfd256-e5a3-43c6-ba26-73134b6a55fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:56.918232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfd256-e5a3-43c6-ba26-73134b6a55fc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:56.918580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfd256-e5a3-43c6-ba26-73134b6a55fc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:56.918866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfd256-e5a3-43c6-ba26-73134b6a55fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:56.926184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfd256-e5a3-43c6-ba26-73134b6a55fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:56.927674 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfd256-e5a3-43c6-ba26-73134b6a55fc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-08dfd256-e5a3-43c6-ba26-73134b6a55fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:56.939713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:56.940632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:56.941527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:56.941527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:56.941527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:56.941527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:56.941527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:56.941527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:56.941527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:56.941527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:56.945798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 344/673] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:56.946659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfd256-e5a3-43c6-ba26-73134b6a55fc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:56.984714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c3c90-decb-4756-af0a-be9083cc12f6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:57.021483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b03d2-3736-47e6-81b9-3bd47962e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:57.022104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b03d2-3736-47e6-81b9-3bd47962e70f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.022384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b03d2-3736-47e6-81b9-3bd47962e70f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.022657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b03d2-3736-47e6-81b9-3bd47962e70f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.023477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b03d2-3736-47e6-81b9-3bd47962e70f None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=ad7a3c5f6b9645fb8cd2a65cee4f37c9) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:57.023787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b03d2-3736-47e6-81b9-3bd47962e70f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:57.025218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b03d2-3736-47e6-81b9-3bd47962e70f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:57.031654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 330/674] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/role_assignments?user.id=ad7a3c5f6b9645fb8cd2a65cee4f37c9&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:57.032465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b03d2-3736-47e6-81b9-3bd47962e70f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:57.059669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfd256-e5a3-43c6-ba26-73134b6a55fc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:57.100055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa7f7b-042c-4e99-80e1-316a302597d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:57.101286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa7f7b-042c-4e99-80e1-316a302597d3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.101636 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa7f7b-042c-4e99-80e1-316a302597d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.101987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa7f7b-042c-4e99-80e1-316a302597d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.114608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:57.123021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa7f7b-042c-4e99-80e1-316a302597d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:57.123021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa7f7b-042c-4e99-80e1-316a302597d3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-46fa7f7b-042c-4e99-80e1-316a302597d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:57.142508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:57.143712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:57.144594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:57.144594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:57.144594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:57.144594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:57.144594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 345/675] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:57.147333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa7f7b-042c-4e99-80e1-316a302597d3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:57.168829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:57.197302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b03d2-3736-47e6-81b9-3bd47962e70f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:57.246615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc13f6e-aa5a-4571-b4d0-980ebe25f413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:57.247246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc13f6e-aa5a-4571-b4d0-980ebe25f413 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.247528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc13f6e-aa5a-4571-b4d0-980ebe25f413 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.247805 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc13f6e-aa5a-4571-b4d0-980ebe25f413 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.248508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc13f6e-aa5a-4571-b4d0-980ebe25f413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:57.248810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc13f6e-aa5a-4571-b4d0-980ebe25f413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:57.250259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc13f6e-aa5a-4571-b4d0-980ebe25f413 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:57.264552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 331/676] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:57.265983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc13f6e-aa5a-4571-b4d0-980ebe25f413 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:57.295710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa7f7b-042c-4e99-80e1-316a302597d3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:57.341758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e63ee-d565-4d70-b777-656299646f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:57.342381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e63ee-d565-4d70-b777-656299646f4b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.342667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e63ee-d565-4d70-b777-656299646f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.343071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e63ee-d565-4d70-b777-656299646f4b None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.343887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e63ee-d565-4d70-b777-656299646f4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:57.344201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e63ee-d565-4d70-b777-656299646f4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:57.345650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e63ee-d565-4d70-b777-656299646f4b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:57.362419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 346/677] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:57.363262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e63ee-d565-4d70-b777-656299646f4b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:57.389258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc13f6e-aa5a-4571-b4d0-980ebe25f413 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:57.433444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bcb63-3dce-4050-bdb1-2348562c5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:57.434124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bcb63-3dce-4050-bdb1-2348562c5a11 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.434404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bcb63-3dce-4050-bdb1-2348562c5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.434726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bcb63-3dce-4050-bdb1-2348562c5a11 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.435464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bcb63-3dce-4050-bdb1-2348562c5a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:57.435769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bcb63-3dce-4050-bdb1-2348562c5a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:57.436371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:57.437277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bcb63-3dce-4050-bdb1-2348562c5a11 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:57.455393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 332/678] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:57.456346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bcb63-3dce-4050-bdb1-2348562c5a11 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:57.459327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:57.492016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e63ee-d565-4d70-b777-656299646f4b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:57.528295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb6140-8447-4e1d-bb5f-64f90433b872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:57.528942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb6140-8447-4e1d-bb5f-64f90433b872 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.529238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb6140-8447-4e1d-bb5f-64f90433b872 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.529504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb6140-8447-4e1d-bb5f-64f90433b872 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.538425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb6140-8447-4e1d-bb5f-64f90433b872 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:57.540367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb6140-8447-4e1d-bb5f-64f90433b872 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-72bb6140-8447-4e1d-bb5f-64f90433b872 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:57.553321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:57.554301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:57.555288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 347/679] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:36:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:57.555950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443db2-4d01-4fe4-8c51-3ea3ff52eb88 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.556555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443db2-4d01-4fe4-8c51-3ea3ff52eb88 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.556555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443db2-4d01-4fe4-8c51-3ea3ff52eb88 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.558089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 348/680] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:57.558662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443db2-4d01-4fe4-8c51-3ea3ff52eb88 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:57.577746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bcb63-3dce-4050-bdb1-2348562c5a11 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:57.619037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eac35c-d67f-41fd-8c96-02987a4a0920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:57.620081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eac35c-d67f-41fd-8c96-02987a4a0920 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.620592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eac35c-d67f-41fd-8c96-02987a4a0920 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.620964 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eac35c-d67f-41fd-8c96-02987a4a0920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.622554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eac35c-d67f-41fd-8c96-02987a4a0920 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=ae1eae16b54c46e9a92f423094085b70) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:57.623400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eac35c-d67f-41fd-8c96-02987a4a0920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:57.625419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eac35c-d67f-41fd-8c96-02987a4a0920 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:57.643348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 333/681] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:57 2022] GET /identity/v3/role_assignments?user.id=ae1eae16b54c46e9a92f423094085b70&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:57.644722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eac35c-d67f-41fd-8c96-02987a4a0920 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:57.692668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443db2-4d01-4fe4-8c51-3ea3ff52eb88 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:57.715378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:57.736695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736311da-09fd-45fa-b31c-ea7716588009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:57.737537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736311da-09fd-45fa-b31c-ea7716588009 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.737901 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736311da-09fd-45fa-b31c-ea7716588009 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.738245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736311da-09fd-45fa-b31c-ea7716588009 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.743315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:57.746624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736311da-09fd-45fa-b31c-ea7716588009 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:57.748323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736311da-09fd-45fa-b31c-ea7716588009 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-736311da-09fd-45fa-b31c-ea7716588009 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:57.765777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:57.766774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:57.767758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:57.767758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:57.767758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:57.767758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:57.767758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:57.767758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:57.767758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:57.767758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:57.772640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 349/682] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:57.774103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe7b13-6e42-46ca-822c-369e11023375 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.774394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe7b13-6e42-46ca-822c-369e11023375 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.774671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe7b13-6e42-46ca-822c-369e11023375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.793251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eac35c-d67f-41fd-8c96-02987a4a0920 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:57.795553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f3fe7b13-6e42-46ca-822c-369e11023375 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:57.797379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f3fe7b13-6e42-46ca-822c-369e11023375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:57.838625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a4309-2a43-4d75-a557-0c07baf32fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:57.840141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a4309-2a43-4d75-a557-0c07baf32fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:57.840434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a4309-2a43-4d75-a557-0c07baf32fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:57.840710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a4309-2a43-4d75-a557-0c07baf32fb3 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:57.841528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a4309-2a43-4d75-a557-0c07baf32fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:57.841834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a4309-2a43-4d75-a557-0c07baf32fb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:57.844200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a4309-2a43-4d75-a557-0c07baf32fb3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:57.867551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 334/683] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 27 07:36:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:57.868425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a4309-2a43-4d75-a557-0c07baf32fb3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:57.882377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 350/684] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:57.882966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe7b13-6e42-46ca-822c-369e11023375 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.004760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe7b13-6e42-46ca-822c-369e11023375 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:58.006405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:58.030665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a4309-2a43-4d75-a557-0c07baf32fb3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:58.052712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b966a8d-2278-41d9-b99b-e816c2863c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:58.053356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b966a8d-2278-41d9-b99b-e816c2863c73 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:58.053638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b966a8d-2278-41d9-b99b-e816c2863c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:58.053897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b966a8d-2278-41d9-b99b-e816c2863c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:58.079303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:58.101101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb771a6-5ac8-413c-bbe3-eef99f8b9698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:58.102962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb771a6-5ac8-413c-bbe3-eef99f8b9698 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:58.103508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb771a6-5ac8-413c-bbe3-eef99f8b9698 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:58.104151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb771a6-5ac8-413c-bbe3-eef99f8b9698 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:58.106705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb771a6-5ac8-413c-bbe3-eef99f8b9698 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:58.107786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb771a6-5ac8-413c-bbe3-eef99f8b9698 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:58.110303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb771a6-5ac8-413c-bbe3-eef99f8b9698 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:58.128938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 335/685] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:58.130087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb771a6-5ac8-413c-bbe3-eef99f8b9698 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.139523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b966a8d-2278-41d9-b99b-e816c2863c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:58.141395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b966a8d-2278-41d9-b99b-e816c2863c73 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:58.248240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 351/686] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 07:36:58.249275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b966a8d-2278-41d9-b99b-e816c2863c73 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.252225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:58.260574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb771a6-5ac8-413c-bbe3-eef99f8b9698 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:58.304368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489025c1-fc4a-4fe9-a6d9-4431e2248bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:58.305355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489025c1-fc4a-4fe9-a6d9-4431e2248bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:58.305825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489025c1-fc4a-4fe9-a6d9-4431e2248bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:58.306289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489025c1-fc4a-4fe9-a6d9-4431e2248bc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:58.319023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489025c1-fc4a-4fe9-a6d9-4431e2248bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-489025c1-fc4a-4fe9-a6d9-4431e2248bc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:36:58.324436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:58.325379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:36:58.326213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:58.330537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 336/687] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:58.331451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489025c1-fc4a-4fe9-a6d9-4431e2248bc3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.374831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b966a8d-2278-41d9-b99b-e816c2863c73 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:58.401196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:58.416157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab054e7f-61b0-45ec-8943-1ca90bcc7521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:58.417144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab054e7f-61b0-45ec-8943-1ca90bcc7521 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:58.417629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab054e7f-61b0-45ec-8943-1ca90bcc7521 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:58.418102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab054e7f-61b0-45ec-8943-1ca90bcc7521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:58.419156 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab054e7f-61b0-45ec-8943-1ca90bcc7521 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=0c65277d89a24081a47a7f928f6c6d28) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:58.419716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab054e7f-61b0-45ec-8943-1ca90bcc7521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:58.421503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab054e7f-61b0-45ec-8943-1ca90bcc7521 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:58.428605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 352/688] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:58 2022] GET /identity/v3/role_assignments?user.id=0c65277d89a24081a47a7f928f6c6d28&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:58.429713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab054e7f-61b0-45ec-8943-1ca90bcc7521 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.469753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489025c1-fc4a-4fe9-a6d9-4431e2248bc3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:58.512407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef544108-4b6f-4d17-99c4-c59b576257e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:58.512746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544108-4b6f-4d17-99c4-c59b576257e8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:58.512940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544108-4b6f-4d17-99c4-c59b576257e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:58.513213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544108-4b6f-4d17-99c4-c59b576257e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:58.528398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef544108-4b6f-4d17-99c4-c59b576257e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:58.530797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef544108-4b6f-4d17-99c4-c59b576257e8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ef544108-4b6f-4d17-99c4-c59b576257e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:58.548623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:58.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:58.550526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:58.550526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:58.550526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:58.550526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:58.550526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 337/689] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:58.555274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef544108-4b6f-4d17-99c4-c59b576257e8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.594558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:58.677427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:58.686025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef544108-4b6f-4d17-99c4-c59b576257e8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:58.689343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab054e7f-61b0-45ec-8943-1ca90bcc7521 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:58.731893 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a35c1-c3a9-4d3b-92cd-837b0f7ad53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:58.733170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a35c1-c3a9-4d3b-92cd-837b0f7ad53f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:58.734593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a35c1-c3a9-4d3b-92cd-837b0f7ad53f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:58.735119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a35c1-c3a9-4d3b-92cd-837b0f7ad53f None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:58.736040 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a35c1-c3a9-4d3b-92cd-837b0f7ad53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:58.736847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a35c1-c3a9-4d3b-92cd-837b0f7ad53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:58.739190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a35c1-c3a9-4d3b-92cd-837b0f7ad53f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:58.743957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcb7a8-32ae-45df-84df-da73edd625fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:58.744661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcb7a8-32ae-45df-84df-da73edd625fe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:58.745078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcb7a8-32ae-45df-84df-da73edd625fe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:58.745400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcb7a8-32ae-45df-84df-da73edd625fe None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:58.746378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcb7a8-32ae-45df-84df-da73edd625fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:58.746754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcb7a8-32ae-45df-84df-da73edd625fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:58.748238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcb7a8-32ae-45df-84df-da73edd625fe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:58.756061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 338/690] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:58.761729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 353/691] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:58.764338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a35c1-c3a9-4d3b-92cd-837b0f7ad53f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.766860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcb7a8-32ae-45df-84df-da73edd625fe None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.875417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcb7a8-32ae-45df-84df-da73edd625fe None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:58.878564 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a35c1-c3a9-4d3b-92cd-837b0f7ad53f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:58.903560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:58.913321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ac011-f8d2-4f90-b2a3-2a4bb231da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:58.914558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ac011-f8d2-4f90-b2a3-2a4bb231da12 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:58.915072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ac011-f8d2-4f90-b2a3-2a4bb231da12 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:58.915556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ac011-f8d2-4f90-b2a3-2a4bb231da12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:58.920510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6bd4c-b882-4d41-91ae-2335da99d883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:58.922030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6bd4c-b882-4d41-91ae-2335da99d883 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:58.922524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6bd4c-b882-4d41-91ae-2335da99d883 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:58.923045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6bd4c-b882-4d41-91ae-2335da99d883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:58.931316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ac011-f8d2-4f90-b2a3-2a4bb231da12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:58.932433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ac011-f8d2-4f90-b2a3-2a4bb231da12 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:58.932989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6bd4c-b882-4d41-91ae-2335da99d883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:58.934790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6bd4c-b882-4d41-91ae-2335da99d883 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b8a6bd4c-b882-4d41-91ae-2335da99d883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:36:58.949463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:58.950512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:58.951460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:36:58.951460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:36:58.951460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:36:58.951460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:36:58.951460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:36:58.951460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:36:58.951460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:36:58.951460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0f6ac011-f8d2-4f90-b2a3-2a4bb231da12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:36:58.951891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:58.952732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:58.953624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:36:58.953624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:36:58.953624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:36:58.953624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:58.953624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 354/692] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:36:58.956231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 339/693] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:58.958220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ac011-f8d2-4f90-b2a3-2a4bb231da12 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.961797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6bd4c-b882-4d41-91ae-2335da99d883 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:58.981692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:59.089126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6bd4c-b882-4d41-91ae-2335da99d883 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:59.116321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ac011-f8d2-4f90-b2a3-2a4bb231da12 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:59.152574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0482ed6-71e1-44ed-8558-7cf6a6e46f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:59.153222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0482ed6-71e1-44ed-8558-7cf6a6e46f9c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:59.153505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0482ed6-71e1-44ed-8558-7cf6a6e46f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:59.153776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0482ed6-71e1-44ed-8558-7cf6a6e46f9c None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:59.154539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0482ed6-71e1-44ed-8558-7cf6a6e46f9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:59.154844 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0482ed6-71e1-44ed-8558-7cf6a6e46f9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:59.156487 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0482ed6-71e1-44ed-8558-7cf6a6e46f9c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:59.158441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80b43b-3008-480f-86f9-2d916415c9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:59.159216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b43b-3008-480f-86f9-2d916415c9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:59.159392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b43b-3008-480f-86f9-2d916415c9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:59.159630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b43b-3008-480f-86f9-2d916415c9b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:59.160325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80b43b-3008-480f-86f9-2d916415c9b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:59.160621 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80b43b-3008-480f-86f9-2d916415c9b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:59.162117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80b43b-3008-480f-86f9-2d916415c9b9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:59.174671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 355/694] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:36:59.181855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 340/695] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:59.183894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80b43b-3008-480f-86f9-2d916415c9b9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:59.188202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0482ed6-71e1-44ed-8558-7cf6a6e46f9c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:59.257628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:59.322368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:59.354270 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80b43b-3008-480f-86f9-2d916415c9b9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:59.362665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0482ed6-71e1-44ed-8558-7cf6a6e46f9c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:59.396956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea4c1-c35d-4c4e-8a93-35a46fa7e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:59.398102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea4c1-c35d-4c4e-8a93-35a46fa7e669 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:59.398535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea4c1-c35d-4c4e-8a93-35a46fa7e669 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:59.398806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea4c1-c35d-4c4e-8a93-35a46fa7e669 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:59.407125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa677f86-0880-4394-8137-3e4d3912f382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:59.409039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa677f86-0880-4394-8137-3e4d3912f382 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:59.409559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa677f86-0880-4394-8137-3e4d3912f382 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:59.409824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aea4c1-c35d-4c4e-8a93-35a46fa7e669 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:59.410260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa677f86-0880-4394-8137-3e4d3912f382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:59.411322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa677f86-0880-4394-8137-3e4d3912f382 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=b5bb94b71d1c452a88f1594a6b011ca6) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:59.411871 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa677f86-0880-4394-8137-3e4d3912f382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:59.412478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aea4c1-c35d-4c4e-8a93-35a46fa7e669 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:59.413747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa677f86-0880-4394-8137-3e4d3912f382 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:59.420987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 341/696] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:36:59 2022] GET /identity/v3/role_assignments?user.id=b5bb94b71d1c452a88f1594a6b011ca6&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:59.422529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141f9cc-dc50-4677-a4f5-c2f3b7133bae None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:59.423054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141f9cc-dc50-4677-a4f5-c2f3b7133bae None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:59.423603 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141f9cc-dc50-4677-a4f5-c2f3b7133bae None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:59.430243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 342/697] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:36:59.432229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294db9b-0d3f-4ef6-b015-0e622a06587e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:59.432629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294db9b-0d3f-4ef6-b015-0e622a06587e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:59.434509 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294db9b-0d3f-4ef6-b015-0e622a06587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-34aea4c1-c35d-4c4e-8a93-35a46fa7e669 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:36:59.451522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:36:59.453271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:36:59.454499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:36:59.456936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 356/698] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 27 07:36:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:36:59.457073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3294db9b-0d3f-4ef6-b015-0e622a06587e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:36:59.462068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3294db9b-0d3f-4ef6-b015-0e622a06587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:36:59.464483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea4c1-c35d-4c4e-8a93-35a46fa7e669 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:59.599044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 343/699] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:36:59.643363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294db9b-0d3f-4ef6-b015-0e622a06587e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:59.654355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:59.658605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea4c1-c35d-4c4e-8a93-35a46fa7e669 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:59.700166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469a78d-cbed-4ca7-b50a-6439d4579e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:59.700166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469a78d-cbed-4ca7-b50a-6439d4579e48 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:59.700166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469a78d-cbed-4ca7-b50a-6439d4579e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:59.700166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469a78d-cbed-4ca7-b50a-6439d4579e48 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:59.700772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469a78d-cbed-4ca7-b50a-6439d4579e48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:36:59.700772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469a78d-cbed-4ca7-b50a-6439d4579e48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:59.701333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469a78d-cbed-4ca7-b50a-6439d4579e48 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:36:59.726938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 357/700] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 27 07:36:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:36:59.731430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469a78d-cbed-4ca7-b50a-6439d4579e48 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:36:59.855188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469a78d-cbed-4ca7-b50a-6439d4579e48 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:59.856320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:59.895658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294db9b-0d3f-4ef6-b015-0e622a06587e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:36:59.900842 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e07e6e-4b66-42ea-abf7-604e9e096775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:59.906908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e07e6e-4b66-42ea-abf7-604e9e096775 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:59.906908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e07e6e-4b66-42ea-abf7-604e9e096775 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:59.906908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e07e6e-4b66-42ea-abf7-604e9e096775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:59.951042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:36:59.974914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48e6c-dae7-4135-a556-e327b478c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:36:59.974914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48e6c-dae7-4135-a556-e327b478c993 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:36:59.974914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48e6c-dae7-4135-a556-e327b478c993 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:36:59.974914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48e6c-dae7-4135-a556-e327b478c993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:36:59.994913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d48e6c-dae7-4135-a556-e327b478c993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:36:59.996099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d48e6c-dae7-4135-a556-e327b478c993 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-92d48e6c-dae7-4135-a556-e327b478c993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:00.022911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:00.023885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:00.024753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:00.024753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:00.024753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:00.024753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:00.024753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 344/701] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:00.027355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48e6c-dae7-4135-a556-e327b478c993 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:00.030138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e07e6e-4b66-42ea-abf7-604e9e096775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:00.032123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e07e6e-4b66-42ea-abf7-604e9e096775 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:00.188786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48e6c-dae7-4135-a556-e327b478c993 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:00.201652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 358/702] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 07:37:00.211974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897947-e595-4f82-8209-cbd38263506b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:00.212266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897947-e595-4f82-8209-cbd38263506b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:00.213985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897947-e595-4f82-8209-cbd38263506b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:00.213985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 359/703] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:00.214681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65897947-e595-4f82-8209-cbd38263506b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:00.220715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:00.237621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c3dcb-3c98-43b4-93a1-c80b38b39690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:00.238261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c3dcb-3c98-43b4-93a1-c80b38b39690 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:00.238540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c3dcb-3c98-43b4-93a1-c80b38b39690 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:00.238814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c3dcb-3c98-43b4-93a1-c80b38b39690 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:00.239565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c3dcb-3c98-43b4-93a1-c80b38b39690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:00.239869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c3dcb-3c98-43b4-93a1-c80b38b39690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:00.241265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c3dcb-3c98-43b4-93a1-c80b38b39690 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:00.260947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 345/704] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:00.263002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46ebb-b08b-4e70-b62c-2e7c3f7d4a0e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:00.263002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46ebb-b08b-4e70-b62c-2e7c3f7d4a0e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:00.263002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46ebb-b08b-4e70-b62c-2e7c3f7d4a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:00.284844 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1ca46ebb-b08b-4e70-b62c-2e7c3f7d4a0e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:00.286078 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1ca46ebb-b08b-4e70-b62c-2e7c3f7d4a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:00.319250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:00.385049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65897947-e595-4f82-8209-cbd38263506b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:00.456368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 346/705] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:37:00.458246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca46ebb-b08b-4e70-b62c-2e7c3f7d4a0e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:00.461515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27976e1-2364-44e0-9284-9d7ed6f9dc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:00.466992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27976e1-2364-44e0-9284-9d7ed6f9dc1f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:00.466992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27976e1-2364-44e0-9284-9d7ed6f9dc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:00.466992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27976e1-2364-44e0-9284-9d7ed6f9dc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:00.485234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27976e1-2364-44e0-9284-9d7ed6f9dc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:00.486906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27976e1-2364-44e0-9284-9d7ed6f9dc1f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c27976e1-2364-44e0-9284-9d7ed6f9dc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:00.503267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:00.504215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:00.505108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:00.505108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:00.505108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:00.505108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:00.505108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 360/706] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:00.505394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27976e1-2364-44e0-9284-9d7ed6f9dc1f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:00.582550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca46ebb-b08b-4e70-b62c-2e7c3f7d4a0e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:00.600345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:00.622017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8cdd1-b0ca-434d-a97e-b9e747afb343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:00.623154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8cdd1-b0ca-434d-a97e-b9e747afb343 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:00.623642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8cdd1-b0ca-434d-a97e-b9e747afb343 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:00.624688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8cdd1-b0ca-434d-a97e-b9e747afb343 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:00.625816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8cdd1-b0ca-434d-a97e-b9e747afb343 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:00.627685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8cdd1-b0ca-434d-a97e-b9e747afb343 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:00.632831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27976e1-2364-44e0-9284-9d7ed6f9dc1f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:00.644544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:00.656145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 347/707] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:37:00 2022] POST /identity/v3/users => generated 254 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:00.657310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8cdd1-b0ca-434d-a97e-b9e747afb343 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:00.690439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf8721-6067-4418-9c34-341c7f882a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:00.691415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf8721-6067-4418-9c34-341c7f882a49 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:00.691530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf8721-6067-4418-9c34-341c7f882a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:00.691785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf8721-6067-4418-9c34-341c7f882a49 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:00.692436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf8721-6067-4418-9c34-341c7f882a49 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:00.693826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf8721-6067-4418-9c34-341c7f882a49 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bebf8721-6067-4418-9c34-341c7f882a49 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:00.720200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:00.721224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:00.722330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 361/708] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jul 27 07:37:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:00.728417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf8721-6067-4418-9c34-341c7f882a49 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:00.782081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8cdd1-b0ca-434d-a97e-b9e747afb343 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:00.821567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c20d2-e5bf-4671-9bb5-7b2ee939572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:00.822686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c20d2-e5bf-4671-9bb5-7b2ee939572c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:00.823199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c20d2-e5bf-4671-9bb5-7b2ee939572c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:00.823766 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c20d2-e5bf-4671-9bb5-7b2ee939572c None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:00.824743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c20d2-e5bf-4671-9bb5-7b2ee939572c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:00.825266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c20d2-e5bf-4671-9bb5-7b2ee939572c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:00.826916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c20d2-e5bf-4671-9bb5-7b2ee939572c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:00.840491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 348/709] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:00.846462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c20d2-e5bf-4671-9bb5-7b2ee939572c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:00.911284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:00.942603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf8721-6067-4418-9c34-341c7f882a49 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:00.992656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462dba-dfd2-4e0a-aa94-ee9e1143a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:00.992656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462dba-dfd2-4e0a-aa94-ee9e1143a5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:00.992656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462dba-dfd2-4e0a-aa94-ee9e1143a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:00.992978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462dba-dfd2-4e0a-aa94-ee9e1143a5e7 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:00.993540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462dba-dfd2-4e0a-aa94-ee9e1143a5e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:00.993849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462dba-dfd2-4e0a-aa94-ee9e1143a5e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:00.995581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462dba-dfd2-4e0a-aa94-ee9e1143a5e7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:01.002697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 362/710] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 27 07:37:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:01.008845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462dba-dfd2-4e0a-aa94-ee9e1143a5e7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:01.041278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c20d2-e5bf-4671-9bb5-7b2ee939572c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:01.053757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:01.091911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a2c3-c60c-4757-915f-b237d73e319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:01.092760 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a2c3-c60c-4757-915f-b237d73e319a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:01.093669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a2c3-c60c-4757-915f-b237d73e319a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:01.094043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a2c3-c60c-4757-915f-b237d73e319a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:01.103321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a2c3-c60c-4757-915f-b237d73e319a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:01.104872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a2c3-c60c-4757-915f-b237d73e319a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ce10a2c3-c60c-4757-915f-b237d73e319a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:01.117700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:01.118818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:01.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:01.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:01.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:01.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:01.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:01.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:01.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:01.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:01.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 349/711] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:01.120507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78611f-7171-4a6f-bdfa-8c5bf41e1625 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:01.120790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78611f-7171-4a6f-bdfa-8c5bf41e1625 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:01.121125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78611f-7171-4a6f-bdfa-8c5bf41e1625 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:01.122606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 350/712] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:01.126989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78611f-7171-4a6f-bdfa-8c5bf41e1625 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:01.137437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462dba-dfd2-4e0a-aa94-ee9e1143a5e7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:01.175928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30838f-6565-448a-92c7-6ce7fc8c9c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:01.176892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30838f-6565-448a-92c7-6ce7fc8c9c43 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:01.177349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30838f-6565-448a-92c7-6ce7fc8c9c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:01.177835 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30838f-6565-448a-92c7-6ce7fc8c9c43 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:01.178826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30838f-6565-448a-92c7-6ce7fc8c9c43 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:01.179342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30838f-6565-448a-92c7-6ce7fc8c9c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:01.181044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30838f-6565-448a-92c7-6ce7fc8c9c43 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:01.188511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 363/713] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 27 07:37:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:01.189936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819deb38-78c9-4092-8b8a-a5ddecac26f7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:01.190400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819deb38-78c9-4092-8b8a-a5ddecac26f7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:01.190930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819deb38-78c9-4092-8b8a-a5ddecac26f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:01.223856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-819deb38-78c9-4092-8b8a-a5ddecac26f7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:01.225866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-819deb38-78c9-4092-8b8a-a5ddecac26f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:01.245446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:01.261487 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78611f-7171-4a6f-bdfa-8c5bf41e1625 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:01.303927 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6d313-5e5b-4977-9615-b78ec45898ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:01.304580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6d313-5e5b-4977-9615-b78ec45898ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:01.304836 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6d313-5e5b-4977-9615-b78ec45898ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:01.305105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6d313-5e5b-4977-9615-b78ec45898ae None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:01.309397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6d313-5e5b-4977-9615-b78ec45898ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:01.309397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6d313-5e5b-4977-9615-b78ec45898ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:01.309397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6d313-5e5b-4977-9615-b78ec45898ae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:01.323503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 351/714] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:01.329998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6d313-5e5b-4977-9615-b78ec45898ae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:01.412352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 364/715] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:37:01.447089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6d313-5e5b-4977-9615-b78ec45898ae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:01.454316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819deb38-78c9-4092-8b8a-a5ddecac26f7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:01.490102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6ae66-5767-4a93-86ec-cb3a3e3d778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:01.491506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6ae66-5767-4a93-86ec-cb3a3e3d778c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:01.491992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6ae66-5767-4a93-86ec-cb3a3e3d778c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:01.492490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6ae66-5767-4a93-86ec-cb3a3e3d778c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:01.493464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6ae66-5767-4a93-86ec-cb3a3e3d778c None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=0445b52b85994510ad9e66de366ebf4d) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:01.493950 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6ae66-5767-4a93-86ec-cb3a3e3d778c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:01.495894 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6ae66-5767-4a93-86ec-cb3a3e3d778c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:01.499438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:01.504543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 352/716] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:01 2022] GET /identity/v3/role_assignments?user.id=0445b52b85994510ad9e66de366ebf4d&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=2ba3b2926541436a9d26782420538af3 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:01.590104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819deb38-78c9-4092-8b8a-a5ddecac26f7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:01.648166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd84a46-f04d-487e-a88d-36bdf53160d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:01.648833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd84a46-f04d-487e-a88d-36bdf53160d2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:01.649114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd84a46-f04d-487e-a88d-36bdf53160d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:01.649387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd84a46-f04d-487e-a88d-36bdf53160d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:01.650036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd84a46-f04d-487e-a88d-36bdf53160d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:01.651472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd84a46-f04d-487e-a88d-36bdf53160d2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5bd84a46-f04d-487e-a88d-36bdf53160d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:01.665019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:01.666201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:01.667134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 365/717] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:01 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:01.672906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6ae66-5767-4a93-86ec-cb3a3e3d778c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:01.701772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:01.834599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6ae66-5767-4a93-86ec-cb3a3e3d778c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:01.882235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3863d3a-562a-4a99-997f-90b015664bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:01.882864 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3863d3a-562a-4a99-997f-90b015664bbe None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:01.883170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3863d3a-562a-4a99-997f-90b015664bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:01.883447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3863d3a-562a-4a99-997f-90b015664bbe None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:01.884143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3863d3a-562a-4a99-997f-90b015664bbe None admin] RBAC: Adding query filter params (name=network) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:01.884449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3863d3a-562a-4a99-997f-90b015664bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:01.885845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3863d3a-562a-4a99-997f-90b015664bbe None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:01.895612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 353/718] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:01.901162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd84a46-f04d-487e-a88d-36bdf53160d2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:02.051223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:02.057019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd84a46-f04d-487e-a88d-36bdf53160d2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:02.088859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658981e-feb8-4c91-9e16-6a8bf587aa17 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:02.089043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658981e-feb8-4c91-9e16-6a8bf587aa17 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:02.089316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658981e-feb8-4c91-9e16-6a8bf587aa17 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:02.090657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 354/719] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:02.100146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f0f8a-30fc-41cf-b7bc-3f71e52e73e2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:02.100493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f0f8a-30fc-41cf-b7bc-3f71e52e73e2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:02.100721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f0f8a-30fc-41cf-b7bc-3f71e52e73e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:02.101809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25205f06-b7c2-452f-a309-4aa6e9479a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:02.102435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25205f06-b7c2-452f-a309-4aa6e9479a05 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:02.102836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25205f06-b7c2-452f-a309-4aa6e9479a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:02.103144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25205f06-b7c2-452f-a309-4aa6e9479a05 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:02.103938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25205f06-b7c2-452f-a309-4aa6e9479a05 None admin] RBAC: Adding query filter params (type=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:02.104245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25205f06-b7c2-452f-a309-4aa6e9479a05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:02.105618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25205f06-b7c2-452f-a309-4aa6e9479a05 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:02.111182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 366/720] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:02.152042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-845f0f8a-30fc-41cf-b7bc-3f71e52e73e2 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:02.153287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-845f0f8a-30fc-41cf-b7bc-3f71e52e73e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:02.269235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 355/721] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:37:02.308598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25205f06-b7c2-452f-a309-4aa6e9479a05 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:02.419164 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25205f06-b7c2-452f-a309-4aa6e9479a05 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:02.463740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d20c0-6a25-4d6d-85be-0378c9af7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:02.464394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d20c0-6a25-4d6d-85be-0378c9af7589 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:02.464677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d20c0-6a25-4d6d-85be-0378c9af7589 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:02.464953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d20c0-6a25-4d6d-85be-0378c9af7589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:02.477335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d20c0-6a25-4d6d-85be-0378c9af7589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2a8d20c0-6a25-4d6d-85be-0378c9af7589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:02.482742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:02.484227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:02.485818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 367/722] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:02.493281 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f0f8a-30fc-41cf-b7bc-3f71e52e73e2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:02.502280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:02.634298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f0f8a-30fc-41cf-b7bc-3f71e52e73e2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:02.680261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2ea00-4403-41da-ba29-204dc73c67b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:02.680811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2ea00-4403-41da-ba29-204dc73c67b4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:02.681092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2ea00-4403-41da-ba29-204dc73c67b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:02.681368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2ea00-4403-41da-ba29-204dc73c67b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:02.682104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2ea00-4403-41da-ba29-204dc73c67b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:02.682406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2ea00-4403-41da-ba29-204dc73c67b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:02.683819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2ea00-4403-41da-ba29-204dc73c67b4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:02.693674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 356/723] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:02.703990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d20c0-6a25-4d6d-85be-0378c9af7589 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:02.743576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:02.976021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d20c0-6a25-4d6d-85be-0378c9af7589 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:03.028306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4042d72-a2b3-47e2-9712-85da3118caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:03.029366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4042d72-a2b3-47e2-9712-85da3118caf6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:03.029841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4042d72-a2b3-47e2-9712-85da3118caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:03.030343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4042d72-a2b3-47e2-9712-85da3118caf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:03.046109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4042d72-a2b3-47e2-9712-85da3118caf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:03.048023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4042d72-a2b3-47e2-9712-85da3118caf6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b4042d72-a2b3-47e2-9712-85da3118caf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:03.071582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:03.072644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:03.074423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:03.074423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:03.074423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:03.074423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:03.083042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 368/724] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:03.087659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2ea00-4403-41da-ba29-204dc73c67b4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:03.200319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:03.253771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2ea00-4403-41da-ba29-204dc73c67b4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:03.299244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1f3e1-dc82-48c8-8b17-63414cdbf512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:03.299870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1f3e1-dc82-48c8-8b17-63414cdbf512 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:03.300150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1f3e1-dc82-48c8-8b17-63414cdbf512 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:03.300421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1f3e1-dc82-48c8-8b17-63414cdbf512 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:03.301198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1f3e1-dc82-48c8-8b17-63414cdbf512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:03.301504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1f3e1-dc82-48c8-8b17-63414cdbf512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:03.302958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1f3e1-dc82-48c8-8b17-63414cdbf512 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:03.320052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 357/725] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:03.325627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4042d72-a2b3-47e2-9712-85da3118caf6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:03.419282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:03.480349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4042d72-a2b3-47e2-9712-85da3118caf6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:03.534418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76317e-e311-4caf-813f-b696ffe948f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:03.535022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76317e-e311-4caf-813f-b696ffe948f6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:03.535305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76317e-e311-4caf-813f-b696ffe948f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:03.535579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76317e-e311-4caf-813f-b696ffe948f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:03.549578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76317e-e311-4caf-813f-b696ffe948f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:03.551085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76317e-e311-4caf-813f-b696ffe948f6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0f76317e-e311-4caf-813f-b696ffe948f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:03.567537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:03.568514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:03.569483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 369/726] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:03.574644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1f3e1-dc82-48c8-8b17-63414cdbf512 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:03.699727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0644b-5f5e-45b1-a3ba-5836a3b0a4e6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:03.700440 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0644b-5f5e-45b1-a3ba-5836a3b0a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:03.700961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0644b-5f5e-45b1-a3ba-5836a3b0a4e6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:03.703976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 370/727] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:03.710715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07589d-05ed-4f08-91a0-5367c48ba1e2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:03.711582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07589d-05ed-4f08-91a0-5367c48ba1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:03.712107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07589d-05ed-4f08-91a0-5367c48ba1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:03.724313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1f3e1-dc82-48c8-8b17-63414cdbf512 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:03.736240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7d07589d-05ed-4f08-91a0-5367c48ba1e2 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:03.737781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7d07589d-05ed-4f08-91a0-5367c48ba1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:03.779236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:03.789795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317695e-a34a-4505-bd06-0a5dc3b0778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:03.790349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317695e-a34a-4505-bd06-0a5dc3b0778a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:03.790624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317695e-a34a-4505-bd06-0a5dc3b0778a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:03.790913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317695e-a34a-4505-bd06-0a5dc3b0778a None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:03.791843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317695e-a34a-4505-bd06-0a5dc3b0778a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:03.792143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317695e-a34a-4505-bd06-0a5dc3b0778a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:03.793685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317695e-a34a-4505-bd06-0a5dc3b0778a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:03.819083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 371/729] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 07:37:03.819280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 358/729] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 27 07:37:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:03.826936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd0cb-b134-4bd7-acb6-92edf82ff5cf None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:03.826936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd0cb-b134-4bd7-acb6-92edf82ff5cf None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:03.826936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd0cb-b134-4bd7-acb6-92edf82ff5cf None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:03.826936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 359/730] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:03.827348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07589d-05ed-4f08-91a0-5367c48ba1e2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:03.828472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e847ac-785a-474a-beed-adf849245f0b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:03.828751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e847ac-785a-474a-beed-adf849245f0b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:03.829018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e847ac-785a-474a-beed-adf849245f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:03.854943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-56e847ac-785a-474a-beed-adf849245f0b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:03.856265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-56e847ac-785a-474a-beed-adf849245f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:03.911318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:03.933393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 360/731] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:37:03.934311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e847ac-785a-474a-beed-adf849245f0b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:03.975345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07589d-05ed-4f08-91a0-5367c48ba1e2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:04.011421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3742d-21df-4d3c-8dd5-607292745097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:04.012157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3742d-21df-4d3c-8dd5-607292745097 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.012431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3742d-21df-4d3c-8dd5-607292745097 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.012705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3742d-21df-4d3c-8dd5-607292745097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.079806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e847ac-785a-474a-beed-adf849245f0b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:04.094059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3742d-21df-4d3c-8dd5-607292745097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:04.095544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3742d-21df-4d3c-8dd5-607292745097 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:04.102636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:04.123696 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388e02f-5f68-4646-9560-3f478626e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:04.125168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388e02f-5f68-4646-9560-3f478626e8fb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.125523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388e02f-5f68-4646-9560-3f478626e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.125795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388e02f-5f68-4646-9560-3f478626e8fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.136450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388e02f-5f68-4646-9560-3f478626e8fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5388e02f-5f68-4646-9560-3f478626e8fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:04.141407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:04.142326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:04.143455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 361/732] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:37:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:04.144302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388e02f-5f68-4646-9560-3f478626e8fb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:04.165596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:04.213787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 372/733] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 07:37:04.215101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c25848-e8ce-4c92-9968-23b445a46dc6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.215373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c25848-e8ce-4c92-9968-23b445a46dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.215646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c25848-e8ce-4c92-9968-23b445a46dc6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.219311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 373/734] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:04.219311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c25848-e8ce-4c92-9968-23b445a46dc6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:04.267066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388e02f-5f68-4646-9560-3f478626e8fb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:04.305182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d899043-03e1-4c03-b7d0-2c3d6654da9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:04.305809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899043-03e1-4c03-b7d0-2c3d6654da9d None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.306095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899043-03e1-4c03-b7d0-2c3d6654da9d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.306366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899043-03e1-4c03-b7d0-2c3d6654da9d None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.307100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d899043-03e1-4c03-b7d0-2c3d6654da9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:04.308467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d899043-03e1-4c03-b7d0-2c3d6654da9d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:04.326581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 362/735] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:37:04 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:04.327544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d899043-03e1-4c03-b7d0-2c3d6654da9d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:04.343218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c25848-e8ce-4c92-9968-23b445a46dc6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:04.378093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:04.393027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63991bf-a0a8-4344-a181-22cc57741ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:04.394845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63991bf-a0a8-4344-a181-22cc57741ceb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.395663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63991bf-a0a8-4344-a181-22cc57741ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.396150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63991bf-a0a8-4344-a181-22cc57741ceb None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.397421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63991bf-a0a8-4344-a181-22cc57741ceb None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:04.398444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63991bf-a0a8-4344-a181-22cc57741ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:04.400224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63991bf-a0a8-4344-a181-22cc57741ceb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:04.417766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 374/736] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:37:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:04.417766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccfd55-c563-414f-8954-0ce49f9cc31a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.417766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccfd55-c563-414f-8954-0ce49f9cc31a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.417766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccfd55-c563-414f-8954-0ce49f9cc31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.446533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e6ccfd55-c563-414f-8954-0ce49f9cc31a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:04.448095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e6ccfd55-c563-414f-8954-0ce49f9cc31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:04.470675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:04.487282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d899043-03e1-4c03-b7d0-2c3d6654da9d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:04.542535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421adad-e825-4a0f-bde4-3b24e5443410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:04.543239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421adad-e825-4a0f-bde4-3b24e5443410 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.543570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421adad-e825-4a0f-bde4-3b24e5443410 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.543781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421adad-e825-4a0f-bde4-3b24e5443410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.546059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 375/737] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:37:04.546876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccfd55-c563-414f-8954-0ce49f9cc31a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:04.560706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421adad-e825-4a0f-bde4-3b24e5443410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:04.564352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421adad-e825-4a0f-bde4-3b24e5443410 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a421adad-e825-4a0f-bde4-3b24e5443410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:04.584816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:04.586233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:04.587141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:04.587141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:04.587141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:04.587141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:04.589289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 363/738] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:04.590321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421adad-e825-4a0f-bde4-3b24e5443410 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:04.659394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccfd55-c563-414f-8954-0ce49f9cc31a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:04.693461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:04.695934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d82cc-117c-40b0-bb72-9306de57ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:04.696708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d82cc-117c-40b0-bb72-9306de57ce4f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.696989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d82cc-117c-40b0-bb72-9306de57ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.697259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d82cc-117c-40b0-bb72-9306de57ce4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.708513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d82cc-117c-40b0-bb72-9306de57ce4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:04.708812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421adad-e825-4a0f-bde4-3b24e5443410 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:04.709959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d82cc-117c-40b0-bb72-9306de57ce4f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-dc1d82cc-117c-40b0-bb72-9306de57ce4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:04.725588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:04.726508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:04.727426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:04.727426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:04.727426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:04.727426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:04.727426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 376/739] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:04.728138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d82cc-117c-40b0-bb72-9306de57ce4f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:04.734611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:04.758048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee347f-fcf5-4ddb-b4d0-c486183a2d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:04.759715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee347f-fcf5-4ddb-b4d0-c486183a2d84 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.760193 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee347f-fcf5-4ddb-b4d0-c486183a2d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.760616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee347f-fcf5-4ddb-b4d0-c486183a2d84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.776525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee347f-fcf5-4ddb-b4d0-c486183a2d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-25ee347f-fcf5-4ddb-b4d0-c486183a2d84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:04.783551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:04.784540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:04.785385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 364/740] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:04.786132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee347f-fcf5-4ddb-b4d0-c486183a2d84 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:04.845527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d82cc-117c-40b0-bb72-9306de57ce4f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:04.885127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a2209-446e-4c7e-8e47-974667652198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:04.885759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2209-446e-4c7e-8e47-974667652198 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.886041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2209-446e-4c7e-8e47-974667652198 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.886316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2209-446e-4c7e-8e47-974667652198 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.887057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a2209-446e-4c7e-8e47-974667652198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:04.887365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a2209-446e-4c7e-8e47-974667652198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:04.888873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a2209-446e-4c7e-8e47-974667652198 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:04.903354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee347f-fcf5-4ddb-b4d0-c486183a2d84 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:04.903860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 377/741] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:04.905270 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07421bb8-0009-457c-8174-f51f4937b327 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.905544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07421bb8-0009-457c-8174-f51f4937b327 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.905821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07421bb8-0009-457c-8174-f51f4937b327 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.911172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 378/742] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:04.911172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07421bb8-0009-457c-8174-f51f4937b327 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:04.949289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cde71-edb0-43c8-9a44-1760456ee504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:04.950167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cde71-edb0-43c8-9a44-1760456ee504 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:04.950599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cde71-edb0-43c8-9a44-1760456ee504 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:04.951045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cde71-edb0-43c8-9a44-1760456ee504 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:04.951888 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cde71-edb0-43c8-9a44-1760456ee504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:04.952384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cde71-edb0-43c8-9a44-1760456ee504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:04.953885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cde71-edb0-43c8-9a44-1760456ee504 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:04.971990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 365/743] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:04.971990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cde71-edb0-43c8-9a44-1760456ee504 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:04.979164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:04.984015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:05.027118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07421bb8-0009-457c-8174-f51f4937b327 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.063300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf18e8-2a6d-4892-bcbe-01cbf2eed70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.063922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf18e8-2a6d-4892-bcbe-01cbf2eed70a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.064201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf18e8-2a6d-4892-bcbe-01cbf2eed70a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.064474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf18e8-2a6d-4892-bcbe-01cbf2eed70a None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.065200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf18e8-2a6d-4892-bcbe-01cbf2eed70a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:05.065503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf18e8-2a6d-4892-bcbe-01cbf2eed70a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.066872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf18e8-2a6d-4892-bcbe-01cbf2eed70a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:05.075840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 379/744] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:05.077164 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342c5be-d7ea-4e14-90cb-2d00cd699b39 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.077453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342c5be-d7ea-4e14-90cb-2d00cd699b39 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.077727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342c5be-d7ea-4e14-90cb-2d00cd699b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.095315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cde71-edb0-43c8-9a44-1760456ee504 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.096499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a342c5be-d7ea-4e14-90cb-2d00cd699b39 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:05.098246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a342c5be-d7ea-4e14-90cb-2d00cd699b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:05.133750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a7dd6-de78-4a9d-ac98-0429ff33105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.134505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a7dd6-de78-4a9d-ac98-0429ff33105b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.134874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a7dd6-de78-4a9d-ac98-0429ff33105b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.135182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a7dd6-de78-4a9d-ac98-0429ff33105b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.142332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a7dd6-de78-4a9d-ac98-0429ff33105b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.143812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a7dd6-de78-4a9d-ac98-0429ff33105b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c09a7dd6-de78-4a9d-ac98-0429ff33105b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:05.156050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:05.157081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 366/745] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:05.157994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a7dd6-de78-4a9d-ac98-0429ff33105b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:05.176143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 380/746] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 07:37:05.177230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342c5be-d7ea-4e14-90cb-2d00cd699b39 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:05.241741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:05.243618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:05.279755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a7dd6-de78-4a9d-ac98-0429ff33105b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.289977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342c5be-d7ea-4e14-90cb-2d00cd699b39 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.316542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38e6ed-a5d0-4a89-bb90-c85e0c8e49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.317507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38e6ed-a5d0-4a89-bb90-c85e0c8e49a0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.317891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38e6ed-a5d0-4a89-bb90-c85e0c8e49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.318265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38e6ed-a5d0-4a89-bb90-c85e0c8e49a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.324497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e42a8-65c3-4066-a6d6-1e85a649922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.325133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e42a8-65c3-4066-a6d6-1e85a649922d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.325410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e42a8-65c3-4066-a6d6-1e85a649922d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.325676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e42a8-65c3-4066-a6d6-1e85a649922d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.326263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38e6ed-a5d0-4a89-bb90-c85e0c8e49a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.327909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38e6ed-a5d0-4a89-bb90-c85e0c8e49a0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:05.335874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e42a8-65c3-4066-a6d6-1e85a649922d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.337316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e42a8-65c3-4066-a6d6-1e85a649922d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5d38e6ed-a5d0-4a89-bb90-c85e0c8e49a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:05.340000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:05.341094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:05.342246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:05.344995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 367/747] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:37:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:05.345937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38e6ed-a5d0-4a89-bb90-c85e0c8e49a0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-663e42a8-65c3-4066-a6d6-1e85a649922d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:05.355264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:05.356533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:05.357436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:05.357436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:05.357436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:05.357436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:05.357436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 381/748] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:05.357436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e42a8-65c3-4066-a6d6-1e85a649922d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:05.487256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e42a8-65c3-4066-a6d6-1e85a649922d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.487809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38e6ed-a5d0-4a89-bb90-c85e0c8e49a0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.495885 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:05.518747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:05.524318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632801bd-8b84-4edd-95de-45cc080b980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.524955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632801bd-8b84-4edd-95de-45cc080b980d None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.525236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632801bd-8b84-4edd-95de-45cc080b980d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.525510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632801bd-8b84-4edd-95de-45cc080b980d None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.526219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632801bd-8b84-4edd-95de-45cc080b980d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.527678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632801bd-8b84-4edd-95de-45cc080b980d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:05.529861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff678b6-2331-4d93-be89-23158ec65250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.530788 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff678b6-2331-4d93-be89-23158ec65250 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.531507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff678b6-2331-4d93-be89-23158ec65250 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.531953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff678b6-2331-4d93-be89-23158ec65250 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.532872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff678b6-2331-4d93-be89-23158ec65250 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:05.533765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff678b6-2331-4d93-be89-23158ec65250 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.535691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff678b6-2331-4d93-be89-23158ec65250 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:05.547329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 382/749] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:37:05 2022] POST /identity/v3/services => generated 240 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:05.548606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632801bd-8b84-4edd-95de-45cc080b980d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:05.550002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 368/750] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:05.550844 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff678b6-2331-4d93-be89-23158ec65250 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:05.672214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff678b6-2331-4d93-be89-23158ec65250 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.718781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632801bd-8b84-4edd-95de-45cc080b980d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.724641 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c501e4-c0c6-4b33-b407-0bfaa093f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.725281 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c501e4-c0c6-4b33-b407-0bfaa093f06d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.725561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c501e4-c0c6-4b33-b407-0bfaa093f06d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.725835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c501e4-c0c6-4b33-b407-0bfaa093f06d None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.726549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c501e4-c0c6-4b33-b407-0bfaa093f06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:05.726854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c501e4-c0c6-4b33-b407-0bfaa093f06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.728414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c501e4-c0c6-4b33-b407-0bfaa093f06d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:05.742835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 369/751] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:05.742835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c501e4-c0c6-4b33-b407-0bfaa093f06d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:05.762096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc457b3e-1d37-4095-b127-17dca32d8a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.762669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457b3e-1d37-4095-b127-17dca32d8a6d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.762991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457b3e-1d37-4095-b127-17dca32d8a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.763266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457b3e-1d37-4095-b127-17dca32d8a6d None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.764079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc457b3e-1d37-4095-b127-17dca32d8a6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:05.764534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc457b3e-1d37-4095-b127-17dca32d8a6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.766097 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc457b3e-1d37-4095-b127-17dca32d8a6d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:05.785721 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 383/752] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 27 07:37:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:05.786577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc457b3e-1d37-4095-b127-17dca32d8a6d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:05.798585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:05.811354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:05.871422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c501e4-c0c6-4b33-b407-0bfaa093f06d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.908977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc457b3e-1d37-4095-b127-17dca32d8a6d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:05.919683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c21fb-400e-42be-a86e-dfdb124ae109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.921679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c21fb-400e-42be-a86e-dfdb124ae109 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.922440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c21fb-400e-42be-a86e-dfdb124ae109 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.922915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c21fb-400e-42be-a86e-dfdb124ae109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.924383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c21fb-400e-42be-a86e-dfdb124ae109 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=b5bb94b71d1c452a88f1594a6b011ca6) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:05.925371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c21fb-400e-42be-a86e-dfdb124ae109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.927742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c21fb-400e-42be-a86e-dfdb124ae109 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:05.936879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 370/753] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:05 2022] GET /identity/v3/role_assignments?user.id=b5bb94b71d1c452a88f1594a6b011ca6&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=2ba3b2926541436a9d26782420538af3 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:05.938250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c21fb-400e-42be-a86e-dfdb124ae109 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:05.971048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a27da4-38e9-49f1-b02c-552ee760bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:05.971930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a27da4-38e9-49f1-b02c-552ee760bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:05.972211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a27da4-38e9-49f1-b02c-552ee760bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:05.972565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a27da4-38e9-49f1-b02c-552ee760bfe1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:05.997014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a27da4-38e9-49f1-b02c-552ee760bfe1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:05.998503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a27da4-38e9-49f1-b02c-552ee760bfe1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-53a27da4-38e9-49f1-b02c-552ee760bfe1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:06.024818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:06.025849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:06.026791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:06.040027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 384/754] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 27 07:37:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:06.045389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a27da4-38e9-49f1-b02c-552ee760bfe1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:06.071251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c21fb-400e-42be-a86e-dfdb124ae109 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:06.088495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:06.119113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d21e50-0f54-482f-9d8e-0fcb24f71192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:06.120109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d21e50-0f54-482f-9d8e-0fcb24f71192 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:06.120576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d21e50-0f54-482f-9d8e-0fcb24f71192 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:06.121033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d21e50-0f54-482f-9d8e-0fcb24f71192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:06.205781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d21e50-0f54-482f-9d8e-0fcb24f71192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:06.207639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d21e50-0f54-482f-9d8e-0fcb24f71192 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:06.215719 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:06.245924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a27da4-38e9-49f1-b02c-552ee760bfe1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:06.289956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c61f6-737a-4875-bca3-34ee0f36d28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:06.290585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c61f6-737a-4875-bca3-34ee0f36d28e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:06.290864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c61f6-737a-4875-bca3-34ee0f36d28e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:06.291179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c61f6-737a-4875-bca3-34ee0f36d28e None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:06.292913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c61f6-737a-4875-bca3-34ee0f36d28e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:06.293225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c61f6-737a-4875-bca3-34ee0f36d28e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:06.294670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c61f6-737a-4875-bca3-34ee0f36d28e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:06.331212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 385/755] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 27 07:37:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:06.339000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c61f6-737a-4875-bca3-34ee0f36d28e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:06.361589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 371/756] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:37:06.367865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d21e50-0f54-482f-9d8e-0fcb24f71192 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:06.389115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:06.520104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c61f6-737a-4875-bca3-34ee0f36d28e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:06.530775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d21e50-0f54-482f-9d8e-0fcb24f71192 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:06.558355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3bf56-88f9-4a1f-90e3-6ab6fb9f8145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:06.559325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3bf56-88f9-4a1f-90e3-6ab6fb9f8145 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:06.559889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3bf56-88f9-4a1f-90e3-6ab6fb9f8145 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:06.560374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3bf56-88f9-4a1f-90e3-6ab6fb9f8145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:06.568570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:06.573417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3bf56-88f9-4a1f-90e3-6ab6fb9f8145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:06.574598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781ac63-89a2-42ca-b9cb-833a67212ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:06.575274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781ac63-89a2-42ca-b9cb-833a67212ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:06.575555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781ac63-89a2-42ca-b9cb-833a67212ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:06.575820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781ac63-89a2-42ca-b9cb-833a67212ce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:06.576209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3bf56-88f9-4a1f-90e3-6ab6fb9f8145 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:06.588924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781ac63-89a2-42ca-b9cb-833a67212ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:06.590368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781ac63-89a2-42ca-b9cb-833a67212ce8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0ac3bf56-88f9-4a1f-90e3-6ab6fb9f8145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:06.595211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:06.596101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:06.597252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:06.597252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:06.597252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:06.597252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:06.599816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 386/757] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:06.601436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6367-12dc-4fa7-bcd8-1cbb7281a793 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:06.601942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6367-12dc-4fa7-bcd8-1cbb7281a793 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:06.602430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6367-12dc-4fa7-bcd8-1cbb7281a793 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:06.604100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 387/758] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:06.608985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6367-12dc-4fa7-bcd8-1cbb7281a793 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-3781ac63-89a2-42ca-b9cb-833a67212ce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:06.610812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:06.611725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:06.613152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:06.613152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:06.613152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:06.613152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:06.613152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 372/759] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:06.613556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092584d0-4486-4d4f-a9b4-eeab659a24bc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:06.613760 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092584d0-4486-4d4f-a9b4-eeab659a24bc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:06.614083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092584d0-4486-4d4f-a9b4-eeab659a24bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:06.640128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-092584d0-4486-4d4f-a9b4-eeab659a24bc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:06.642034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-092584d0-4486-4d4f-a9b4-eeab659a24bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:06.718147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:06.732413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6367-12dc-4fa7-bcd8-1cbb7281a793 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:06.738906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 373/760] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:06.738906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092584d0-4486-4d4f-a9b4-eeab659a24bc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:06.796556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8387-8b74-44c5-a767-ec9ac0933b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:06.797193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8387-8b74-44c5-a767-ec9ac0933b9c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:06.797799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8387-8b74-44c5-a767-ec9ac0933b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:06.798212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8387-8b74-44c5-a767-ec9ac0933b9c None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:06.799041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8387-8b74-44c5-a767-ec9ac0933b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:06.799717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8387-8b74-44c5-a767-ec9ac0933b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:06.801944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8387-8b74-44c5-a767-ec9ac0933b9c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:06.819503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 388/761] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:06.820529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8387-8b74-44c5-a767-ec9ac0933b9c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:06.866876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092584d0-4486-4d4f-a9b4-eeab659a24bc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:06.885429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:06.919181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2010b5-4552-47f1-806f-cfcaca7e4073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:06.920103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2010b5-4552-47f1-806f-cfcaca7e4073 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:06.920403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2010b5-4552-47f1-806f-cfcaca7e4073 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:06.920797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2010b5-4552-47f1-806f-cfcaca7e4073 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:06.922108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2010b5-4552-47f1-806f-cfcaca7e4073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:06.922561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2010b5-4552-47f1-806f-cfcaca7e4073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:06.924242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2010b5-4552-47f1-806f-cfcaca7e4073 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:06.940961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8387-8b74-44c5-a767-ec9ac0933b9c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:06.941283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 374/762] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:06.942195 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2010b5-4552-47f1-806f-cfcaca7e4073 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:06.979880 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba690f4-3b5f-480b-b49f-ac8cc2ab2ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:06.980813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba690f4-3b5f-480b-b49f-ac8cc2ab2ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:06.981492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba690f4-3b5f-480b-b49f-ac8cc2ab2ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:06.981814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba690f4-3b5f-480b-b49f-ac8cc2ab2ad2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:06.982709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba690f4-3b5f-480b-b49f-ac8cc2ab2ad2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:06.985530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba690f4-3b5f-480b-b49f-ac8cc2ab2ad2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5ba690f4-3b5f-480b-b49f-ac8cc2ab2ad2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:06.997176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:06.998152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:06.999545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 389/763] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jul 27 07:37:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:07.001065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba690f4-3b5f-480b-b49f-ac8cc2ab2ad2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:07.013425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:07.072171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2010b5-4552-47f1-806f-cfcaca7e4073 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:07.110778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a66e2-88cd-44b7-b0d6-38212576f06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:07.111701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a66e2-88cd-44b7-b0d6-38212576f06e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.112343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a66e2-88cd-44b7-b0d6-38212576f06e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.112614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a66e2-88cd-44b7-b0d6-38212576f06e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.114759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba690f4-3b5f-480b-b49f-ac8cc2ab2ad2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:07.121060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a66e2-88cd-44b7-b0d6-38212576f06e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:07.123078 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a66e2-88cd-44b7-b0d6-38212576f06e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:07.130141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6f4a66e2-88cd-44b7-b0d6-38212576f06e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:07.138629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:07.140300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:07.142207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:07.142207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:07.142207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:07.142207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:07.142207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:07.142207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:07.142207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:07.142207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:07.143200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 375/764] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:07.144862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a66e2-88cd-44b7-b0d6-38212576f06e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:07.164211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb8ffe-21a4-4979-92d1-07038df1e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:07.165121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb8ffe-21a4-4979-92d1-07038df1e211 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.165396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb8ffe-21a4-4979-92d1-07038df1e211 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.166045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb8ffe-21a4-4979-92d1-07038df1e211 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.175621 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb8ffe-21a4-4979-92d1-07038df1e211 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:07.177715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb8ffe-21a4-4979-92d1-07038df1e211 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3aeb8ffe-21a4-4979-92d1-07038df1e211 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:07.196431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:07.198460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 390/765] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:07.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb8ffe-21a4-4979-92d1-07038df1e211 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:07.260683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a66e2-88cd-44b7-b0d6-38212576f06e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:07.280540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:07.315507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db8cff-6933-4e25-9dd0-79e03d464fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:07.316392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db8cff-6933-4e25-9dd0-79e03d464fdd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.316676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db8cff-6933-4e25-9dd0-79e03d464fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.316944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db8cff-6933-4e25-9dd0-79e03d464fdd None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.317630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db8cff-6933-4e25-9dd0-79e03d464fdd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:07.317930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db8cff-6933-4e25-9dd0-79e03d464fdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:07.319330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db8cff-6933-4e25-9dd0-79e03d464fdd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:07.324393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb8ffe-21a4-4979-92d1-07038df1e211 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:07.325047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 376/766] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 27 07:37:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:07.325863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db8cff-6933-4e25-9dd0-79e03d464fdd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:07.362976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7fb59-1926-4981-93af-944c97b1a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:07.363983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7fb59-1926-4981-93af-944c97b1a547 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.364518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7fb59-1926-4981-93af-944c97b1a547 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.364998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7fb59-1926-4981-93af-944c97b1a547 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.366003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7fb59-1926-4981-93af-944c97b1a547 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:07.366531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7fb59-1926-4981-93af-944c97b1a547 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:07.368230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7fb59-1926-4981-93af-944c97b1a547 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:07.382024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 391/767] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:07.383226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7fb59-1926-4981-93af-944c97b1a547 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:07.428572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:07.457630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db8cff-6933-4e25-9dd0-79e03d464fdd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:07.494160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f795d-3ed4-4572-832f-843cf112b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:07.495180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f795d-3ed4-4572-832f-843cf112b5ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.495762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f795d-3ed4-4572-832f-843cf112b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.496233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f795d-3ed4-4572-832f-843cf112b5ae None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.497256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f795d-3ed4-4572-832f-843cf112b5ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:07.497779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f795d-3ed4-4572-832f-843cf112b5ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:07.500106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f795d-3ed4-4572-832f-843cf112b5ae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:07.513690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7fb59-1926-4981-93af-944c97b1a547 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:07.519361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 377/768] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:07.520461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f795d-3ed4-4572-832f-843cf112b5ae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:07.555426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fab7ab-2d4b-42b6-a036-b2ee97a4d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:07.556098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fab7ab-2d4b-42b6-a036-b2ee97a4d605 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.556320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fab7ab-2d4b-42b6-a036-b2ee97a4d605 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.556591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fab7ab-2d4b-42b6-a036-b2ee97a4d605 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.557278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fab7ab-2d4b-42b6-a036-b2ee97a4d605 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:07.557578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fab7ab-2d4b-42b6-a036-b2ee97a4d605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:07.559578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fab7ab-2d4b-42b6-a036-b2ee97a4d605 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:07.566634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 392/769] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 27 07:37:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:07.567480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fab7ab-2d4b-42b6-a036-b2ee97a4d605 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:07.569016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:07.638296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f795d-3ed4-4572-832f-843cf112b5ae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:07.673307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:07.676859 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fab7ab-2d4b-42b6-a036-b2ee97a4d605 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:07.679231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313bdb-3966-4ec2-b740-65432001b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:07.680323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313bdb-3966-4ec2-b740-65432001b014 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.680805 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313bdb-3966-4ec2-b740-65432001b014 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.681300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313bdb-3966-4ec2-b740-65432001b014 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/0445b52b85994510ad9e66de366ebf4d/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.683632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec313bdb-3966-4ec2-b740-65432001b014 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=0445b52b85994510ad9e66de366ebf4d, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:07.685438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec313bdb-3966-4ec2-b740-65432001b014 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:07.703207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 378/770] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:37:07 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/0445b52b85994510ad9e66de366ebf4d/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:37:07.704578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313bdb-3966-4ec2-b740-65432001b014 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:07.731747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7af6f-577b-400f-bcc6-5c2418248e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:07.732372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7af6f-577b-400f-bcc6-5c2418248e41 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.732651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7af6f-577b-400f-bcc6-5c2418248e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.732922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7af6f-577b-400f-bcc6-5c2418248e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.734306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7af6f-577b-400f-bcc6-5c2418248e41 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=cc423c22d64144d6aece926a64444e4e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:07.734681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7af6f-577b-400f-bcc6-5c2418248e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:07.736178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7af6f-577b-400f-bcc6-5c2418248e41 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:07.749824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 393/771] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:07 2022] GET /identity/v3/role_assignments?user.id=cc423c22d64144d6aece926a64444e4e&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:07.857037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:07.862269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313bdb-3966-4ec2-b740-65432001b014 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:07.921802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614b71c-bfc1-452c-b7c5-540c1e7702ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:07.922366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614b71c-bfc1-452c-b7c5-540c1e7702ec None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.922645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614b71c-bfc1-452c-b7c5-540c1e7702ec None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.922935 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614b71c-bfc1-452c-b7c5-540c1e7702ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.923846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614b71c-bfc1-452c-b7c5-540c1e7702ec None admin] RBAC: Adding query filter params (interface=public, service_id=6f47cb7e69084f8b8a2693ae0c52f86a, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:07.924221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614b71c-bfc1-452c-b7c5-540c1e7702ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:07.925752 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614b71c-bfc1-452c-b7c5-540c1e7702ec None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:07.936010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 379/772] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 27 07:37:07 2022] GET /identity/v3/endpoints?service_id=6f47cb7e69084f8b8a2693ae0c52f86a&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:07.941580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7af6f-577b-400f-bcc6-5c2418248e41 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:07.956556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cadd2b-f631-484c-a45d-e464ba23507a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.956898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cadd2b-f631-484c-a45d-e464ba23507a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.957102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cadd2b-f631-484c-a45d-e464ba23507a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.958744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 380/773] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:07.964722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c5603-7676-4e9a-814d-628dfe7b0ec0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:07.964916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c5603-7676-4e9a-814d-628dfe7b0ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:07.965288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c5603-7676-4e9a-814d-628dfe7b0ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:07.990915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-be0c5603-7676-4e9a-814d-628dfe7b0ec0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:07.990915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-be0c5603-7676-4e9a-814d-628dfe7b0ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:08.100414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 381/774] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:08.119666 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7af6f-577b-400f-bcc6-5c2418248e41 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:08.153153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c5603-7676-4e9a-814d-628dfe7b0ec0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:08.168033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b421fde-98b7-429f-82d1-77f4778c1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:08.169794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421fde-98b7-429f-82d1-77f4778c1435 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:08.170074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421fde-98b7-429f-82d1-77f4778c1435 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:08.170343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421fde-98b7-429f-82d1-77f4778c1435 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:08.172204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421fde-98b7-429f-82d1-77f4778c1435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:08.175269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421fde-98b7-429f-82d1-77f4778c1435 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:08.185441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 394/775] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 27 07:37:07 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:08.283829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:08.295308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c5603-7676-4e9a-814d-628dfe7b0ec0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:08.333508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a2ff-8268-40a4-a3f1-67140119bd10 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:08.333837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a2ff-8268-40a4-a3f1-67140119bd10 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:08.334065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a2ff-8268-40a4-a3f1-67140119bd10 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:08.335780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 395/776] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:08.341529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb82f4-0abd-427c-9c9c-00ec47df49ef None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:08.341826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb82f4-0abd-427c-9c9c-00ec47df49ef None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:08.342086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb82f4-0abd-427c-9c9c-00ec47df49ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:08.350825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dd8d7-a1f1-431e-8dc1-349ca1cba819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:08.351636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dd8d7-a1f1-431e-8dc1-349ca1cba819 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:08.351914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dd8d7-a1f1-431e-8dc1-349ca1cba819 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:08.352178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dd8d7-a1f1-431e-8dc1-349ca1cba819 None admin] PATH_INFO: `/v3/services/network` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:08.352887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dd8d7-a1f1-431e-8dc1-349ca1cba819 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:08.354279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dd8d7-a1f1-431e-8dc1-349ca1cba819 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:08.362485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-54cb82f4-0abd-427c-9c9c-00ec47df49ef None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:08.363757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-54cb82f4-0abd-427c-9c9c-00ec47df49ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-326dd8d7-a1f1-431e-8dc1-349ca1cba819 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:08.370170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:08.371230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:08.372270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 382/777] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:08 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:08.386388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dd8d7-a1f1-431e-8dc1-349ca1cba819 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:08.404964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:08.487819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 396/778] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:08.510378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb82f4-0abd-427c-9c9c-00ec47df49ef None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:08.526608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dd8d7-a1f1-431e-8dc1-349ca1cba819 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:08.588581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4d500-2cb8-4ed6-8339-a73a72334fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:08.589610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4d500-2cb8-4ed6-8339-a73a72334fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:08.590087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4d500-2cb8-4ed6-8339-a73a72334fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:08.590565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4d500-2cb8-4ed6-8339-a73a72334fa0 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:08.591493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4d500-2cb8-4ed6-8339-a73a72334fa0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:08.592157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4d500-2cb8-4ed6-8339-a73a72334fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:08.594569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4d500-2cb8-4ed6-8339-a73a72334fa0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:08.603623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 383/779] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:08.609404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4d500-2cb8-4ed6-8339-a73a72334fa0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:08.632667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:08.735155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb82f4-0abd-427c-9c9c-00ec47df49ef None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:08.767683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeb70a-134d-4fe9-a2ce-7eb7c92f3092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:08.768337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb70a-134d-4fe9-a2ce-7eb7c92f3092 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:08.768616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb70a-134d-4fe9-a2ce-7eb7c92f3092 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:08.768890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb70a-134d-4fe9-a2ce-7eb7c92f3092 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:08.780930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4d500-2cb8-4ed6-8339-a73a72334fa0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:08.793350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeb70a-134d-4fe9-a2ce-7eb7c92f3092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f3aeb70a-134d-4fe9-a2ce-7eb7c92f3092 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:08.800953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:08.801873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:08.802707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:08.807892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 397/780] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:08.810249 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeb70a-134d-4fe9-a2ce-7eb7c92f3092 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:08.849378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:08.858769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2ad04-f59d-4ac3-8e97-21975601842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:08.859426 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ad04-f59d-4ac3-8e97-21975601842a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:08.859700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ad04-f59d-4ac3-8e97-21975601842a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:08.859974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ad04-f59d-4ac3-8e97-21975601842a None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:08.860671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2ad04-f59d-4ac3-8e97-21975601842a None admin] RBAC: Adding query filter params (type=network) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:08.860976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2ad04-f59d-4ac3-8e97-21975601842a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:08.862422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2ad04-f59d-4ac3-8e97-21975601842a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:08.871100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 384/781] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:08.877951 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2ad04-f59d-4ac3-8e97-21975601842a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:08.957352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeb70a-134d-4fe9-a2ce-7eb7c92f3092 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:08.994443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d855f6-9bd0-4859-a791-16ec0d79e6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:08.995018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d855f6-9bd0-4859-a791-16ec0d79e6af None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:08.995410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d855f6-9bd0-4859-a791-16ec0d79e6af None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:08.995691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d855f6-9bd0-4859-a791-16ec0d79e6af None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:08.996418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d855f6-9bd0-4859-a791-16ec0d79e6af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:08.996723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d855f6-9bd0-4859-a791-16ec0d79e6af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:08.998201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d855f6-9bd0-4859-a791-16ec0d79e6af None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:09.007764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 398/782] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:09.015014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d855f6-9bd0-4859-a791-16ec0d79e6af None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:09.064829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:09.094445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2ad04-f59d-4ac3-8e97-21975601842a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:09.103747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:09.129862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d855f6-9bd0-4859-a791-16ec0d79e6af None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:09.174101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4ef82-97d0-4881-b872-1c2b27c779cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:09.174749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4ef82-97d0-4881-b872-1c2b27c779cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:09.175053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4ef82-97d0-4881-b872-1c2b27c779cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:09.175324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4ef82-97d0-4881-b872-1c2b27c779cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:09.187639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f6bd6-6ea2-47fb-9a96-b83b3e893c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:09.188345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f6bd6-6ea2-47fb-9a96-b83b3e893c63 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:09.188630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f6bd6-6ea2-47fb-9a96-b83b3e893c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:09.188902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f6bd6-6ea2-47fb-9a96-b83b3e893c63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:09.189678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f6bd6-6ea2-47fb-9a96-b83b3e893c63 None admin] RBAC: Adding query filter params (interface=public, service_id=af7aabede02e4c56b3d5422c4650c38d, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:09.189988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f6bd6-6ea2-47fb-9a96-b83b3e893c63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:09.191391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f6bd6-6ea2-47fb-9a96-b83b3e893c63 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:09.198042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4ef82-97d0-4881-b872-1c2b27c779cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:09.200521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4ef82-97d0-4881-b872-1c2b27c779cd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:09.204050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 385/783] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 27 07:37:08 2022] GET /identity/v3/endpoints?service_id=af7aabede02e4c56b3d5422c4650c38d&interface=public®ion_id=RegionOne => generated 194 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:09.210116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f6bd6-6ea2-47fb-9a96-b83b3e893c63 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3cd4ef82-97d0-4881-b872-1c2b27c779cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:09.230603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:09.231598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:09.232480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:09.232480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:09.232480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:09.232480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:09.235997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 399/784] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:09.241878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4ef82-97d0-4881-b872-1c2b27c779cd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:09.372216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f6bd6-6ea2-47fb-9a96-b83b3e893c63 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:09.402524 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4ef82-97d0-4881-b872-1c2b27c779cd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:09.415596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0815f9c-4815-4531-ba0d-af7b60fae35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:09.416229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0815f9c-4815-4531-ba0d-af7b60fae35b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:09.416506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0815f9c-4815-4531-ba0d-af7b60fae35b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:09.416865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0815f9c-4815-4531-ba0d-af7b60fae35b None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:09.417534 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0815f9c-4815-4531-ba0d-af7b60fae35b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:09.421773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0815f9c-4815-4531-ba0d-af7b60fae35b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:09.428905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 386/785] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 27 07:37:09 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:09.445666 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:09.452736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420b86f-83d0-467f-a298-4b2e4e4346b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:09.453844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420b86f-83d0-467f-a298-4b2e4e4346b9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:09.454517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420b86f-83d0-467f-a298-4b2e4e4346b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:09.454875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420b86f-83d0-467f-a298-4b2e4e4346b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:09.456041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420b86f-83d0-467f-a298-4b2e4e4346b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:09.456420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420b86f-83d0-467f-a298-4b2e4e4346b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:09.457937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420b86f-83d0-467f-a298-4b2e4e4346b9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:09.471839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 400/786] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:09.477617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0815f9c-4815-4531-ba0d-af7b60fae35b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:09.495053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:09.588787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0815f9c-4815-4531-ba0d-af7b60fae35b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:09.633324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302188a8-9599-41d0-8b9e-a8fa31361e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:09.633907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302188a8-9599-41d0-8b9e-a8fa31361e11 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:09.634189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302188a8-9599-41d0-8b9e-a8fa31361e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:09.634460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302188a8-9599-41d0-8b9e-a8fa31361e11 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:09.647717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302188a8-9599-41d0-8b9e-a8fa31361e11 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:09.649200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302188a8-9599-41d0-8b9e-a8fa31361e11 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-302188a8-9599-41d0-8b9e-a8fa31361e11 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:09.673292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:09.674299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:09.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 387/787] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:09.683903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420b86f-83d0-467f-a298-4b2e4e4346b9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:09.887321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420b86f-83d0-467f-a298-4b2e4e4346b9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:09.969492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef92442-8c21-4214-aef2-c141ed8da8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:09.970541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef92442-8c21-4214-aef2-c141ed8da8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:09.971060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef92442-8c21-4214-aef2-c141ed8da8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:09.971795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef92442-8c21-4214-aef2-c141ed8da8f2 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:09.973301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef92442-8c21-4214-aef2-c141ed8da8f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:09.973845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef92442-8c21-4214-aef2-c141ed8da8f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:09.976558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef92442-8c21-4214-aef2-c141ed8da8f2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:10.009817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 401/788] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 27 07:37:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:10.018078 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302188a8-9599-41d0-8b9e-a8fa31361e11 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:10.132662 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:10.171778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302188a8-9599-41d0-8b9e-a8fa31361e11 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:10.228194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd15ed2-f979-4e9a-9a7f-4d9f141bac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:10.228860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd15ed2-f979-4e9a-9a7f-4d9f141bac0c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.229139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd15ed2-f979-4e9a-9a7f-4d9f141bac0c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.229408 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd15ed2-f979-4e9a-9a7f-4d9f141bac0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.241675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd15ed2-f979-4e9a-9a7f-4d9f141bac0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:10.243188 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd15ed2-f979-4e9a-9a7f-4d9f141bac0c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6cd15ed2-f979-4e9a-9a7f-4d9f141bac0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:10.264364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:10.265391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:10.266306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:10.266306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:10.266306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:10.266306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:10.267920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 388/789] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:10.273170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef92442-8c21-4214-aef2-c141ed8da8f2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:10.344941 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:10.380454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da9481-6818-44ef-9c27-2bfb1a5e2a8c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.381351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da9481-6818-44ef-9c27-2bfb1a5e2a8c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.381826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da9481-6818-44ef-9c27-2bfb1a5e2a8c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.387587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 389/790] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:10.397459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476998bf-3f44-4a2f-89eb-22aa3b38b906 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.398094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476998bf-3f44-4a2f-89eb-22aa3b38b906 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.398587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476998bf-3f44-4a2f-89eb-22aa3b38b906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.422502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef92442-8c21-4214-aef2-c141ed8da8f2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:10.446878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-476998bf-3f44-4a2f-89eb-22aa3b38b906 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:10.448117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-476998bf-3f44-4a2f-89eb-22aa3b38b906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:10.457578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d539ba-4291-475f-929b-2fa1e0eecf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:10.458201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d539ba-4291-475f-929b-2fa1e0eecf86 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.458483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d539ba-4291-475f-929b-2fa1e0eecf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.458761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d539ba-4291-475f-929b-2fa1e0eecf86 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.459519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d539ba-4291-475f-929b-2fa1e0eecf86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:10.459836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d539ba-4291-475f-929b-2fa1e0eecf86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:10.461303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d539ba-4291-475f-929b-2fa1e0eecf86 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:10.474518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 402/791] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:10.480268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d539ba-4291-475f-929b-2fa1e0eecf86 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:10.563950 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 390/792] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:10.566298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f8f5-935c-45e0-a714-507df7d981b2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.567023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f8f5-935c-45e0-a714-507df7d981b2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.567483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f8f5-935c-45e0-a714-507df7d981b2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.569138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 391/793] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:10.574916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a26d9-eaa9-4201-8c03-2cb66c3f14e0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.575531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a26d9-eaa9-4201-8c03-2cb66c3f14e0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.575956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a26d9-eaa9-4201-8c03-2cb66c3f14e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.602585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-039a26d9-eaa9-4201-8c03-2cb66c3f14e0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:10.604497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-039a26d9-eaa9-4201-8c03-2cb66c3f14e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:10.624408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d539ba-4291-475f-929b-2fa1e0eecf86 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:10.637404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:10.671031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3471b04-0bc6-4828-b603-f78b26f6f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:10.671389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:10.671704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3471b04-0bc6-4828-b603-f78b26f6f12d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.671985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3471b04-0bc6-4828-b603-f78b26f6f12d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.672465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3471b04-0bc6-4828-b603-f78b26f6f12d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.680480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3471b04-0bc6-4828-b603-f78b26f6f12d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:10.681874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3471b04-0bc6-4828-b603-f78b26f6f12d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:10.695084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 392/794] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:10.695084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a26d9-eaa9-4201-8c03-2cb66c3f14e0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f3471b04-0bc6-4828-b603-f78b26f6f12d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:10.703108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:10.704229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:10.705242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:10.705242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:10.705242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:10.705242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:10.705242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:10.705242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:10.705242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:10.705242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:10.707347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 403/795] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:10.708770 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8e83-4d17-412a-85d5-93b633c8df3f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.709203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8e83-4d17-412a-85d5-93b633c8df3f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.709624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8e83-4d17-412a-85d5-93b633c8df3f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.711345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 404/796] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:10.714305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af8e83-4d17-412a-85d5-93b633c8df3f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:10.830133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a26d9-eaa9-4201-8c03-2cb66c3f14e0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:10.838641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af8e83-4d17-412a-85d5-93b633c8df3f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:10.870196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82906cb4-884a-4a60-8649-468eb20f3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:10.871220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82906cb4-884a-4a60-8649-468eb20f3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.871676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82906cb4-884a-4a60-8649-468eb20f3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.872132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82906cb4-884a-4a60-8649-468eb20f3fb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.879539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc2489-051b-42a7-a4c6-22cc822dad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:10.880216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2489-051b-42a7-a4c6-22cc822dad7a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.880496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2489-051b-42a7-a4c6-22cc822dad7a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.880766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2489-051b-42a7-a4c6-22cc822dad7a None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.881527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc2489-051b-42a7-a4c6-22cc822dad7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:10.881831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc2489-051b-42a7-a4c6-22cc822dad7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:10.883299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc2489-051b-42a7-a4c6-22cc822dad7a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:10.886280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82906cb4-884a-4a60-8649-468eb20f3fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-82906cb4-884a-4a60-8649-468eb20f3fb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:10.891294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:10.892269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:10.893094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 393/797] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:10.893779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427942-f250-4623-a3f0-0f1e78e401d9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:10.894186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427942-f250-4623-a3f0-0f1e78e401d9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:10.894186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427942-f250-4623-a3f0-0f1e78e401d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:10.902981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 405/798] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:10.904407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc2489-051b-42a7-a4c6-22cc822dad7a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:10.919520 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-89427942-f250-4623-a3f0-0f1e78e401d9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:10.921294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-89427942-f250-4623-a3f0-0f1e78e401d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:10.938135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:10.968761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:11.002421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 394/799] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:11.003422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89427942-f250-4623-a3f0-0f1e78e401d9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.044192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc2489-051b-42a7-a4c6-22cc822dad7a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:11.103202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ce0d7-3389-4634-b587-034aec22d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:11.104274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ce0d7-3389-4634-b587-034aec22d9cc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:11.104782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ce0d7-3389-4634-b587-034aec22d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:11.105280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ce0d7-3389-4634-b587-034aec22d9cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:11.114381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89427942-f250-4623-a3f0-0f1e78e401d9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:11.123337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ce0d7-3389-4634-b587-034aec22d9cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-076ce0d7-3389-4634-b587-034aec22d9cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:11.133237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:11.134358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:37:11.135423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:11.136371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 406/800] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:37:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:11.137009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ce0d7-3389-4634-b587-034aec22d9cc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.153577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933a72c-3661-4259-9c58-693cd3df5a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:11.154483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a72c-3661-4259-9c58-693cd3df5a29 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:11.155572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a72c-3661-4259-9c58-693cd3df5a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:11.155987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a72c-3661-4259-9c58-693cd3df5a29 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:11.157056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933a72c-3661-4259-9c58-693cd3df5a29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:11.157497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933a72c-3661-4259-9c58-693cd3df5a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:11.159170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933a72c-3661-4259-9c58-693cd3df5a29 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:11.174173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 395/801] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:11.175325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933a72c-3661-4259-9c58-693cd3df5a29 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.227438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:11.256811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:11.270878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ce0d7-3389-4634-b587-034aec22d9cc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:11.302271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933a72c-3661-4259-9c58-693cd3df5a29 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:11.309111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f4a6c-0be4-472a-afb3-9acd07b25429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:11.310212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f4a6c-0be4-472a-afb3-9acd07b25429 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:11.310493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f4a6c-0be4-472a-afb3-9acd07b25429 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:11.310766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f4a6c-0be4-472a-afb3-9acd07b25429 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/b5bb94b71d1c452a88f1594a6b011ca6/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:11.313400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f4a6c-0be4-472a-afb3-9acd07b25429 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=b5bb94b71d1c452a88f1594a6b011ca6, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:11.314849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f4a6c-0be4-472a-afb3-9acd07b25429 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:11.331385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 407/802] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:37:11 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/b5bb94b71d1c452a88f1594a6b011ca6/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:37:11.332604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f4a6c-0be4-472a-afb3-9acd07b25429 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.352181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423015f8-ff33-4d06-9873-72ddecca8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:11.353661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423015f8-ff33-4d06-9873-72ddecca8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:11.354195 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423015f8-ff33-4d06-9873-72ddecca8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:11.354877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423015f8-ff33-4d06-9873-72ddecca8bd0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:11.355915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423015f8-ff33-4d06-9873-72ddecca8bd0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:11.357960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423015f8-ff33-4d06-9873-72ddecca8bd0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-423015f8-ff33-4d06-9873-72ddecca8bd0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:11.369310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:11.370365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 07:37:11.371263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:11.375176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 396/803] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jul 27 07:37:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:11.376366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423015f8-ff33-4d06-9873-72ddecca8bd0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.463415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f4a6c-0be4-472a-afb3-9acd07b25429 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:11.505742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc1776-4cf8-4a27-aa61-24783554430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:11.506296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc1776-4cf8-4a27-aa61-24783554430b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:11.506571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc1776-4cf8-4a27-aa61-24783554430b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:11.506839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc1776-4cf8-4a27-aa61-24783554430b None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:11.508168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc1776-4cf8-4a27-aa61-24783554430b None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:11.508168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc1776-4cf8-4a27-aa61-24783554430b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:11.509399 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc1776-4cf8-4a27-aa61-24783554430b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:11.523676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 408/804] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:37:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:11.524560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc1776-4cf8-4a27-aa61-24783554430b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.526276 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:11.529808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423015f8-ff33-4d06-9873-72ddecca8bd0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:11.541058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:11.573907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563e01-416d-4cb3-b083-65ac1409ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:11.574611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563e01-416d-4cb3-b083-65ac1409ee5b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:11.574909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563e01-416d-4cb3-b083-65ac1409ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:11.575175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563e01-416d-4cb3-b083-65ac1409ee5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:11.588399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c563e01-416d-4cb3-b083-65ac1409ee5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:11.590081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c563e01-416d-4cb3-b083-65ac1409ee5b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9c563e01-416d-4cb3-b083-65ac1409ee5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:11.606776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:11.607756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:11.609086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:11.609086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:11.609086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:11.609086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:11.609086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 397/805] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:11.609398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563e01-416d-4cb3-b083-65ac1409ee5b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.667971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc1776-4cf8-4a27-aa61-24783554430b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:11.718265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f02f8-0ee6-4319-aee9-96424ffb4e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:11.719179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f02f8-0ee6-4319-aee9-96424ffb4e1b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:11.719521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f02f8-0ee6-4319-aee9-96424ffb4e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:11.719886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f02f8-0ee6-4319-aee9-96424ffb4e1b None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:11.720644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f02f8-0ee6-4319-aee9-96424ffb4e1b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:11.721110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f02f8-0ee6-4319-aee9-96424ffb4e1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:11.723055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f02f8-0ee6-4319-aee9-96424ffb4e1b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:11.732368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563e01-416d-4cb3-b083-65ac1409ee5b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:11.734163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 409/806] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 27 07:37:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:11.735113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f02f8-0ee6-4319-aee9-96424ffb4e1b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.777371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fd418-4fca-4ac4-b7b2-3f6b1b0e0aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:11.778373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd418-4fca-4ac4-b7b2-3f6b1b0e0aec None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:11.779267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd418-4fca-4ac4-b7b2-3f6b1b0e0aec None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:11.779541 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd418-4fca-4ac4-b7b2-3f6b1b0e0aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:11.794544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fd418-4fca-4ac4-b7b2-3f6b1b0e0aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:11.798927 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fd418-4fca-4ac4-b7b2-3f6b1b0e0aec None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9a5fd418-4fca-4ac4-b7b2-3f6b1b0e0aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:11.819874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:11.820826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:11.821698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:11.821698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:11.821698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:11.821698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:11.823257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:11.825507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 398/807] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:11.827724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fd418-4fca-4ac4-b7b2-3f6b1b0e0aec None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.834614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:11.863275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f02f8-0ee6-4319-aee9-96424ffb4e1b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:11.903015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae667c88-54c8-4339-95f6-df7b34def7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:11.903741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae667c88-54c8-4339-95f6-df7b34def7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:11.904152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae667c88-54c8-4339-95f6-df7b34def7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:11.904520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae667c88-54c8-4339-95f6-df7b34def7a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:11.905869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae667c88-54c8-4339-95f6-df7b34def7a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:11.906240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae667c88-54c8-4339-95f6-df7b34def7a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:11.907807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae667c88-54c8-4339-95f6-df7b34def7a8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:11.924498 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 410/808] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:11.925527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae667c88-54c8-4339-95f6-df7b34def7a8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:11.971065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fd418-4fca-4ac4-b7b2-3f6b1b0e0aec None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.017289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0128b-fb94-4aca-8be5-9c8a1877f909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:12.017970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0128b-fb94-4aca-8be5-9c8a1877f909 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.018250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0128b-fb94-4aca-8be5-9c8a1877f909 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.018575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0128b-fb94-4aca-8be5-9c8a1877f909 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.019462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0128b-fb94-4aca-8be5-9c8a1877f909 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:12.019700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0128b-fb94-4aca-8be5-9c8a1877f909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:12.021015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0128b-fb94-4aca-8be5-9c8a1877f909 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:12.031406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 399/809] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 27 07:37:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:12.031406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0128b-fb94-4aca-8be5-9c8a1877f909 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:12.043932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae667c88-54c8-4339-95f6-df7b34def7a8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.081833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21682817-272a-4243-a6be-bf861dc68daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:12.082453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21682817-272a-4243-a6be-bf861dc68daf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.082730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21682817-272a-4243-a6be-bf861dc68daf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.083033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21682817-272a-4243-a6be-bf861dc68daf None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.083746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21682817-272a-4243-a6be-bf861dc68daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:12.084033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21682817-272a-4243-a6be-bf861dc68daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:12.085407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21682817-272a-4243-a6be-bf861dc68daf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:12.087137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:12.099689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 411/810] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:12.101035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626ecb7-fbae-4386-9b4d-deae234c583d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.101319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626ecb7-fbae-4386-9b4d-deae234c583d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.101589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626ecb7-fbae-4386-9b4d-deae234c583d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.107207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 412/811] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:12.107207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626ecb7-fbae-4386-9b4d-deae234c583d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:12.117160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:12.161549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0128b-fb94-4aca-8be5-9c8a1877f909 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.199424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75439a0-8808-4a9d-b45f-ba60476da77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:12.200239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75439a0-8808-4a9d-b45f-ba60476da77f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.200354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75439a0-8808-4a9d-b45f-ba60476da77f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.201114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75439a0-8808-4a9d-b45f-ba60476da77f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.210592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75439a0-8808-4a9d-b45f-ba60476da77f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:12.212126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75439a0-8808-4a9d-b45f-ba60476da77f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e75439a0-8808-4a9d-b45f-ba60476da77f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:12.227120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:12.228167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:12.229135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 400/812] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 27 07:37:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:12.230237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75439a0-8808-4a9d-b45f-ba60476da77f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:12.238434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626ecb7-fbae-4386-9b4d-deae234c583d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.276570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee833a17-dac7-4143-b36d-293a35b9f418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:12.277198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833a17-dac7-4143-b36d-293a35b9f418 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.277483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833a17-dac7-4143-b36d-293a35b9f418 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.277755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833a17-dac7-4143-b36d-293a35b9f418 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.278463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee833a17-dac7-4143-b36d-293a35b9f418 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:12.279904 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee833a17-dac7-4143-b36d-293a35b9f418 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:12.303243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 413/813] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:37:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:12.304494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ed634-7ea5-469a-a06d-0c378690fcf5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.304784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ed634-7ea5-469a-a06d-0c378690fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.305059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ed634-7ea5-469a-a06d-0c378690fcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.325231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b51ed634-7ea5-469a-a06d-0c378690fcf5 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:12.326485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b51ed634-7ea5-469a-a06d-0c378690fcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:12.362381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75439a0-8808-4a9d-b45f-ba60476da77f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.396478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:12.401156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:12.435251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba77f0-a57f-4c59-aad7-1028a32fa9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:12.436359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba77f0-a57f-4c59-aad7-1028a32fa9cd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.436875 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba77f0-a57f-4c59-aad7-1028a32fa9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.437376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba77f0-a57f-4c59-aad7-1028a32fa9cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.445121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 414/814] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:12.445121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ed634-7ea5-469a-a06d-0c378690fcf5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:12.456302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba77f0-a57f-4c59-aad7-1028a32fa9cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:12.458368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba77f0-a57f-4c59-aad7-1028a32fa9cd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-92ba77f0-a57f-4c59-aad7-1028a32fa9cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:12.481312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:12.482380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:12.483391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:12.485285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 401/815] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:37:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:12.491170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba77f0-a57f-4c59-aad7-1028a32fa9cd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:12.577252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ed634-7ea5-469a-a06d-0c378690fcf5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.617743 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508e147-5793-4b83-ba8f-cfbd7bb1e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:12.618473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e147-5793-4b83-ba8f-cfbd7bb1e5cf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.618758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e147-5793-4b83-ba8f-cfbd7bb1e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.619084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e147-5793-4b83-ba8f-cfbd7bb1e5cf None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.619894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508e147-5793-4b83-ba8f-cfbd7bb1e5cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:12.620197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508e147-5793-4b83-ba8f-cfbd7bb1e5cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:12.621894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508e147-5793-4b83-ba8f-cfbd7bb1e5cf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:12.624477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba77f0-a57f-4c59-aad7-1028a32fa9cd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.642022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 415/816] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 27 07:37:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:12.643515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508e147-5793-4b83-ba8f-cfbd7bb1e5cf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:12.668630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22620b-2aba-41ff-a977-fc6b0f3788d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:12.669277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22620b-2aba-41ff-a977-fc6b0f3788d1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.670098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22620b-2aba-41ff-a977-fc6b0f3788d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.670531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22620b-2aba-41ff-a977-fc6b0f3788d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.671500 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22620b-2aba-41ff-a977-fc6b0f3788d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:12.673172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22620b-2aba-41ff-a977-fc6b0f3788d1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:12.683696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ec22620b-2aba-41ff-a977-fc6b0f3788d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:12.688280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:12.689272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:12.690101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 402/817] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:12 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:12.691112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22620b-2aba-41ff-a977-fc6b0f3788d1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:12.759207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:12.763247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508e147-5793-4b83-ba8f-cfbd7bb1e5cf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.806329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc699c84-a646-4733-8d3f-c295f2c8c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:12.807161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc699c84-a646-4733-8d3f-c295f2c8c9ab None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.807543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc699c84-a646-4733-8d3f-c295f2c8c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.807929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc699c84-a646-4733-8d3f-c295f2c8c9ab None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.808841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc699c84-a646-4733-8d3f-c295f2c8c9ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:12.809266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc699c84-a646-4733-8d3f-c295f2c8c9ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:12.810949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc699c84-a646-4733-8d3f-c295f2c8c9ab None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:12.833811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22620b-2aba-41ff-a977-fc6b0f3788d1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.838998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 416/818] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 27 07:37:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:12.840034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc699c84-a646-4733-8d3f-c295f2c8c9ab None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:12.890239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e608c2d-7a7a-47ef-8389-6a9f783047a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:12.891193 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e608c2d-7a7a-47ef-8389-6a9f783047a8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:12.891537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e608c2d-7a7a-47ef-8389-6a9f783047a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:12.891846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e608c2d-7a7a-47ef-8389-6a9f783047a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:12.953534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:12.969181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc699c84-a646-4733-8d3f-c295f2c8c9ab None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:12.979287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e608c2d-7a7a-47ef-8389-6a9f783047a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:12.981438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e608c2d-7a7a-47ef-8389-6a9f783047a8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:13.007647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16979e1a-c73f-4f3b-821f-e2780ebbdd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:13.008486 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16979e1a-c73f-4f3b-821f-e2780ebbdd0d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.009054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16979e1a-c73f-4f3b-821f-e2780ebbdd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.009054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16979e1a-c73f-4f3b-821f-e2780ebbdd0d None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.009922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16979e1a-c73f-4f3b-821f-e2780ebbdd0d None admin] RBAC: Adding query filter params (name=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:13.010322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16979e1a-c73f-4f3b-821f-e2780ebbdd0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:13.011849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16979e1a-c73f-4f3b-821f-e2780ebbdd0d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:13.018176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 417/819] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:13.019346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16979e1a-c73f-4f3b-821f-e2780ebbdd0d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:13.053279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:13.120195 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 403/820] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:37:13.121212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e608c2d-7a7a-47ef-8389-6a9f783047a8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:13.167918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16979e1a-c73f-4f3b-821f-e2780ebbdd0d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:13.214801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8790f3-9570-47ae-9e2c-4563cff0e3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:13.215751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8790f3-9570-47ae-9e2c-4563cff0e3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.216184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8790f3-9570-47ae-9e2c-4563cff0e3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.216648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8790f3-9570-47ae-9e2c-4563cff0e3c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.230973 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8790f3-9570-47ae-9e2c-4563cff0e3c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:13.232782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8790f3-9570-47ae-9e2c-4563cff0e3c9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-fb8790f3-9570-47ae-9e2c-4563cff0e3c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:13.251049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:13.252226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:13.253350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:13.253350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:13.253350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:13.253350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:13.255315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 418/821] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:13.256311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8790f3-9570-47ae-9e2c-4563cff0e3c9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:13.269121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:13.274826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e608c2d-7a7a-47ef-8389-6a9f783047a8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:13.311099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ce353-b805-40b8-b6e8-c13d44df4267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:13.312699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ce353-b805-40b8-b6e8-c13d44df4267 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.312699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ce353-b805-40b8-b6e8-c13d44df4267 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.313098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ce353-b805-40b8-b6e8-c13d44df4267 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.313962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ce353-b805-40b8-b6e8-c13d44df4267 None admin] RBAC: Adding query filter params (type=network) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:13.314326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ce353-b805-40b8-b6e8-c13d44df4267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:13.315867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ce353-b805-40b8-b6e8-c13d44df4267 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:13.321588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 404/822] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:13.322728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ce353-b805-40b8-b6e8-c13d44df4267 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:13.339238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:13.382304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8790f3-9570-47ae-9e2c-4563cff0e3c9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:13.431818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89e57f-4d38-43d1-ae05-f71d3528b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:13.432848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89e57f-4d38-43d1-ae05-f71d3528b184 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.432848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89e57f-4d38-43d1-ae05-f71d3528b184 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.433129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89e57f-4d38-43d1-ae05-f71d3528b184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.444670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ce353-b805-40b8-b6e8-c13d44df4267 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:13.446342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89e57f-4d38-43d1-ae05-f71d3528b184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:13.448617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89e57f-4d38-43d1-ae05-f71d3528b184 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ab89e57f-4d38-43d1-ae05-f71d3528b184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:13.465760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:13.467308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:13.468362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:13.468362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:13.468362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:13.468362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:13.468362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 419/823] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:13.469301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89e57f-4d38-43d1-ae05-f71d3528b184 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:13.488493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62561090-e158-4f45-b9cc-0235b800e811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:13.489567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62561090-e158-4f45-b9cc-0235b800e811 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.490277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62561090-e158-4f45-b9cc-0235b800e811 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.490731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62561090-e158-4f45-b9cc-0235b800e811 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.491636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62561090-e158-4f45-b9cc-0235b800e811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:13.492078 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62561090-e158-4f45-b9cc-0235b800e811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:13.494301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62561090-e158-4f45-b9cc-0235b800e811 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:13.514131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 405/824] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:13.514131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62561090-e158-4f45-b9cc-0235b800e811 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:13.536882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:13.585740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89e57f-4d38-43d1-ae05-f71d3528b184 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:13.593656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:13.624187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008b3e6-2a95-4d9e-8074-0c9bc038c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:13.624804 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b3e6-2a95-4d9e-8074-0c9bc038c1b3 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.625076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b3e6-2a95-4d9e-8074-0c9bc038c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.625488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b3e6-2a95-4d9e-8074-0c9bc038c1b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.626520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008b3e6-2a95-4d9e-8074-0c9bc038c1b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:13.628188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008b3e6-2a95-4d9e-8074-0c9bc038c1b3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:13.628901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62561090-e158-4f45-b9cc-0235b800e811 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:13.652179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 420/825] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:37:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:13.653631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4094-95e6-42c9-99d2-642f17f08c54 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.653914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4094-95e6-42c9-99d2-642f17f08c54 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.654234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4094-95e6-42c9-99d2-642f17f08c54 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.659037 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 421/826] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:13.660302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa4094-95e6-42c9-99d2-642f17f08c54 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:13.681259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b4e88-3488-475a-b9ac-253131c246b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:13.681909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b4e88-3488-475a-b9ac-253131c246b9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.682185 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b4e88-3488-475a-b9ac-253131c246b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.682777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b4e88-3488-475a-b9ac-253131c246b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.684232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b4e88-3488-475a-b9ac-253131c246b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:13.684524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b4e88-3488-475a-b9ac-253131c246b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:13.687168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b4e88-3488-475a-b9ac-253131c246b9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:13.705739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 406/827] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:13.708213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ea89-3fcb-4199-b209-10f4ef7cb4fc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.708832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ea89-3fcb-4199-b209-10f4ef7cb4fc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.709347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ea89-3fcb-4199-b209-10f4ef7cb4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.735858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1d98ea89-3fcb-4199-b209-10f4ef7cb4fc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:13.738123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1d98ea89-3fcb-4199-b209-10f4ef7cb4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:13.802038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa4094-95e6-42c9-99d2-642f17f08c54 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:13.826949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:13.852641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faff88-2a07-4096-9c46-b49a3ab17e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:13.853690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faff88-2a07-4096-9c46-b49a3ab17e3f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:13.853972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faff88-2a07-4096-9c46-b49a3ab17e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:13.854302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faff88-2a07-4096-9c46-b49a3ab17e3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:13.855982 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 407/828] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:13.856595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98ea89-3fcb-4199-b209-10f4ef7cb4fc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:13.866585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faff88-2a07-4096-9c46-b49a3ab17e3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:13.866585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faff88-2a07-4096-9c46-b49a3ab17e3f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e9faff88-2a07-4096-9c46-b49a3ab17e3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:13.884490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:13.885657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:13.887056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:13.887056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:13.887056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:13.887056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:13.887056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:13.887056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:13.887056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:13.887056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:13.887056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 422/829] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:13.887713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faff88-2a07-4096-9c46-b49a3ab17e3f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:13.929173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:13.976167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98ea89-3fcb-4199-b209-10f4ef7cb4fc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.003933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faff88-2a07-4096-9c46-b49a3ab17e3f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.013951 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9395d-907c-42e5-a4ca-1ad66d5c76b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.014713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9395d-907c-42e5-a4ca-1ad66d5c76b9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.015024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9395d-907c-42e5-a4ca-1ad66d5c76b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.015300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9395d-907c-42e5-a4ca-1ad66d5c76b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.022842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9395d-907c-42e5-a4ca-1ad66d5c76b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:14.024444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9395d-907c-42e5-a4ca-1ad66d5c76b9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c4c9395d-907c-42e5-a4ca-1ad66d5c76b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:14.036611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:14.037522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:14.038398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:14.038398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:14.038398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:14.038398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:14.038398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:14.038398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:14.038398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:14.038398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:14.038398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 408/830] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:14.038936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9395d-907c-42e5-a4ca-1ad66d5c76b9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:14.043133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce4419-499a-48fd-b725-c98d033b3a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.043800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce4419-499a-48fd-b725-c98d033b3a1b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.044079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce4419-499a-48fd-b725-c98d033b3a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.044349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce4419-499a-48fd-b725-c98d033b3a1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.058488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce4419-499a-48fd-b725-c98d033b3a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-93ce4419-499a-48fd-b725-c98d033b3a1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:14.064088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:14.065133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:14.066187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:14.070309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 423/831] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:14.071007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce4419-499a-48fd-b725-c98d033b3a1b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:14.110259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:14.162860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9395d-907c-42e5-a4ca-1ad66d5c76b9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.182336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:14.194878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce4419-499a-48fd-b725-c98d033b3a1b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.201931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435d953-4874-465b-9d64-0a08b7cebb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.203471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435d953-4874-465b-9d64-0a08b7cebb05 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.204249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435d953-4874-465b-9d64-0a08b7cebb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.204722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435d953-4874-465b-9d64-0a08b7cebb05 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.205783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435d953-4874-465b-9d64-0a08b7cebb05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:14.206164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435d953-4874-465b-9d64-0a08b7cebb05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:14.208946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435d953-4874-465b-9d64-0a08b7cebb05 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:14.222870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 409/832] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:14.223755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435d953-4874-465b-9d64-0a08b7cebb05 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:14.244313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed4361-8abe-41f9-81f8-c6a15eec32cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.245245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed4361-8abe-41f9-81f8-c6a15eec32cf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.246165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed4361-8abe-41f9-81f8-c6a15eec32cf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.246623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed4361-8abe-41f9-81f8-c6a15eec32cf None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.247873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed4361-8abe-41f9-81f8-c6a15eec32cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:14.249014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed4361-8abe-41f9-81f8-c6a15eec32cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:14.251040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed4361-8abe-41f9-81f8-c6a15eec32cf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:14.268938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 424/833] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:14.270443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed4361-8abe-41f9-81f8-c6a15eec32cf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:14.330683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435d953-4874-465b-9d64-0a08b7cebb05 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.367744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f5bbb-9cc4-43f7-b360-fe4101c3a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.368359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f5bbb-9cc4-43f7-b360-fe4101c3a9da None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.368640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f5bbb-9cc4-43f7-b360-fe4101c3a9da None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.368908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f5bbb-9cc4-43f7-b360-fe4101c3a9da None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.369628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f5bbb-9cc4-43f7-b360-fe4101c3a9da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:14.369925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f5bbb-9cc4-43f7-b360-fe4101c3a9da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:14.371303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f5bbb-9cc4-43f7-b360-fe4101c3a9da None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:14.380771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 410/834] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:37:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:14.381798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f5bbb-9cc4-43f7-b360-fe4101c3a9da None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:14.391950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:14.398163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed4361-8abe-41f9-81f8-c6a15eec32cf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.438588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fd8e0-eb28-4749-9e61-fddabf56e505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.439213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fd8e0-eb28-4749-9e61-fddabf56e505 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.439824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:14.440183 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fd8e0-eb28-4749-9e61-fddabf56e505 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.440564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fd8e0-eb28-4749-9e61-fddabf56e505 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/cc423c22d64144d6aece926a64444e4e/roles/acd4741d776c40b8b1f5563ad208b994` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.458297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fd8e0-eb28-4749-9e61-fddabf56e505 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=cc423c22d64144d6aece926a64444e4e, role_id=acd4741d776c40b8b1f5563ad208b994)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:14.459967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fd8e0-eb28-4749-9e61-fddabf56e505 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:14.474077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 425/835] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:37:14 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/cc423c22d64144d6aece926a64444e4e/roles/acd4741d776c40b8b1f5563ad208b994 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:37:14.480020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fd8e0-eb28-4749-9e61-fddabf56e505 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:14.516343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f5bbb-9cc4-43f7-b360-fe4101c3a9da None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.566098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2345a-b4eb-456c-8ed5-ef3ea6d56e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.567240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2345a-b4eb-456c-8ed5-ef3ea6d56e8f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.568414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2345a-b4eb-456c-8ed5-ef3ea6d56e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.568903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2345a-b4eb-456c-8ed5-ef3ea6d56e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.570345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2345a-b4eb-456c-8ed5-ef3ea6d56e8f None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=0445b52b85994510ad9e66de366ebf4d) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:14.570903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2345a-b4eb-456c-8ed5-ef3ea6d56e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:14.573368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2345a-b4eb-456c-8ed5-ef3ea6d56e8f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:14.580703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 411/836] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:14 2022] GET /identity/v3/role_assignments?user.id=0445b52b85994510ad9e66de366ebf4d&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=2ba3b2926541436a9d26782420538af3 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:14.582014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038f4c-a80a-4d0a-8d4e-c0e0bc56f83c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.582294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038f4c-a80a-4d0a-8d4e-c0e0bc56f83c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.582562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038f4c-a80a-4d0a-8d4e-c0e0bc56f83c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.583976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 412/837] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:14.593754 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04049-19f3-4882-9cc4-e33ea9b4bc91 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.594383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04049-19f3-4882-9cc4-e33ea9b4bc91 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.594824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04049-19f3-4882-9cc4-e33ea9b4bc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.621439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-70d04049-19f3-4882-9cc4-e33ea9b4bc91 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:14.624517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-70d04049-19f3-4882-9cc4-e33ea9b4bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:14.633456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fd8e0-eb28-4749-9e61-fddabf56e505 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.683330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce137cf-c480-4902-a8d8-065a18d15155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.684095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce137cf-c480-4902-a8d8-065a18d15155 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.684383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce137cf-c480-4902-a8d8-065a18d15155 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.684659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce137cf-c480-4902-a8d8-065a18d15155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.701049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce137cf-c480-4902-a8d8-065a18d15155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:14.704545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce137cf-c480-4902-a8d8-065a18d15155 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:14.719359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:14.730650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 413/838] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0ce137cf-c480-4902-a8d8-065a18d15155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:14.735501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:14.736829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:14.738504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:14.738504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:14.738504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:14.738504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:14.738504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 426/839] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:14.743529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d04049-19f3-4882-9cc4-e33ea9b4bc91 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:14.758002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce137cf-c480-4902-a8d8-065a18d15155 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:14.788099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:14.869009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d04049-19f3-4882-9cc4-e33ea9b4bc91 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.879595 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce137cf-c480-4902-a8d8-065a18d15155 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:14.905619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffdfd-7805-4d00-a622-d7f38fe04f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.906255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffdfd-7805-4d00-a622-d7f38fe04f2b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.906535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffdfd-7805-4d00-a622-d7f38fe04f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.906809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffdfd-7805-4d00-a622-d7f38fe04f2b None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.907566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ffdfd-7805-4d00-a622-d7f38fe04f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:14.907873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ffdfd-7805-4d00-a622-d7f38fe04f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:14.909250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ffdfd-7805-4d00-a622-d7f38fe04f2b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:14.922609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 414/840] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:14.925474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676dfd7-0fec-467e-bb35-c66070f46e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:14.926123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676dfd7-0fec-467e-bb35-c66070f46e19 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:14.926402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676dfd7-0fec-467e-bb35-c66070f46e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:14.926673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676dfd7-0fec-467e-bb35-c66070f46e19 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:14.927478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676dfd7-0fec-467e-bb35-c66070f46e19 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:14.927996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffdfd-7805-4d00-a622-d7f38fe04f2b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:14.929026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676dfd7-0fec-467e-bb35-c66070f46e19 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0676dfd7-0fec-467e-bb35-c66070f46e19 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:14.941538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:14.942613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:14.943487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 427/841] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:37:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:14.950251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676dfd7-0fec-467e-bb35-c66070f46e19 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:15.035355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:15.044063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:15.054089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffdfd-7805-4d00-a622-d7f38fe04f2b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:15.073600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676dfd7-0fec-467e-bb35-c66070f46e19 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:15.098622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0175a58-63da-4301-841c-130cb6767a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:15.099609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0175a58-63da-4301-841c-130cb6767a4a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:15.100024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0175a58-63da-4301-841c-130cb6767a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:15.100515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0175a58-63da-4301-841c-130cb6767a4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:15.110250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0175a58-63da-4301-841c-130cb6767a4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:15.111986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0175a58-63da-4301-841c-130cb6767a4a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:15.118064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276c06-41e8-4828-9d37-eddb906e4cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:15.119197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276c06-41e8-4828-9d37-eddb906e4cec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:15.119632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276c06-41e8-4828-9d37-eddb906e4cec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:15.120078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276c06-41e8-4828-9d37-eddb906e4cec None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:15.120917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83276c06-41e8-4828-9d37-eddb906e4cec None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:15.121376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83276c06-41e8-4828-9d37-eddb906e4cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:15.122915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83276c06-41e8-4828-9d37-eddb906e4cec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d0175a58-63da-4301-841c-130cb6767a4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:15.124750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:15.125865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:15.127031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 415/842] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:15.131422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0175a58-63da-4301-841c-130cb6767a4a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:15.132100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 428/843] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:37:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:15.137091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276c06-41e8-4828-9d37-eddb906e4cec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:15.252576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0175a58-63da-4301-841c-130cb6767a4a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:15.281351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276c06-41e8-4828-9d37-eddb906e4cec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:15.289808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3aeb-c433-4602-9127-9c6e49f622a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:15.290361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3aeb-c433-4602-9127-9c6e49f622a5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:15.291068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3aeb-c433-4602-9127-9c6e49f622a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:15.291068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3aeb-c433-4602-9127-9c6e49f622a5 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:15.291804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f3aeb-c433-4602-9127-9c6e49f622a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:15.292160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f3aeb-c433-4602-9127-9c6e49f622a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:15.293823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f3aeb-c433-4602-9127-9c6e49f622a5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:15.312701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:15.318665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 416/844] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 27 07:37:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:15.319694 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3aeb-c433-4602-9127-9c6e49f622a5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:15.324423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a23d1b-a993-4608-829e-c89907ff71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:15.325297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a23d1b-a993-4608-829e-c89907ff71d0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:15.325778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a23d1b-a993-4608-829e-c89907ff71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:15.326269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a23d1b-a993-4608-829e-c89907ff71d0 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:15.327258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a23d1b-a993-4608-829e-c89907ff71d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:15.327769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a23d1b-a993-4608-829e-c89907ff71d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:15.329448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a23d1b-a993-4608-829e-c89907ff71d0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:15.335125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 429/845] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:37:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:15.340949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:15.444509 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3aeb-c433-4602-9127-9c6e49f622a5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:15.484934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686564-29c9-45d1-8ee5-57e1dc1d7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:15.485570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de686564-29c9-45d1-8ee5-57e1dc1d7a20 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:15.485851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de686564-29c9-45d1-8ee5-57e1dc1d7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:15.486125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de686564-29c9-45d1-8ee5-57e1dc1d7a20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:15.560647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de686564-29c9-45d1-8ee5-57e1dc1d7a20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:15.562166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de686564-29c9-45d1-8ee5-57e1dc1d7a20 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:15.576550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:15.670752 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 417/846] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:37:15.676996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a23d1b-a993-4608-829e-c89907ff71d0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:15.790513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a23d1b-a993-4608-829e-c89907ff71d0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:15.826281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa5f9d-2098-4ef7-aa39-48bfc333928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:15.827594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5f9d-2098-4ef7-aa39-48bfc333928f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:15.827873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5f9d-2098-4ef7-aa39-48bfc333928f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:15.828144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5f9d-2098-4ef7-aa39-48bfc333928f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:15.839703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa5f9d-2098-4ef7-aa39-48bfc333928f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:15.841178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa5f9d-2098-4ef7-aa39-48bfc333928f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-cbaa5f9d-2098-4ef7-aa39-48bfc333928f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:15.858190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:15.859247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:15.860157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:15.860157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:15.860157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:15.860157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:15.860157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 430/847] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:15.866572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686564-29c9-45d1-8ee5-57e1dc1d7a20 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:15.970704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686564-29c9-45d1-8ee5-57e1dc1d7a20 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:15.989356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:16.011322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9bbcc-491f-4960-a7cd-8212d6481acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:16.011954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9bbcc-491f-4960-a7cd-8212d6481acd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:16.012236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9bbcc-491f-4960-a7cd-8212d6481acd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:16.012509 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9bbcc-491f-4960-a7cd-8212d6481acd None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:16.013208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9bbcc-491f-4960-a7cd-8212d6481acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:16.013510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9bbcc-491f-4960-a7cd-8212d6481acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:16.014921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9bbcc-491f-4960-a7cd-8212d6481acd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:16.026778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 418/848] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:16.032236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa5f9d-2098-4ef7-aa39-48bfc333928f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:16.081741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:16.144809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa5f9d-2098-4ef7-aa39-48bfc333928f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:16.182308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed9d79-9261-4e7b-ae92-df7f031b315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:16.182979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed9d79-9261-4e7b-ae92-df7f031b315c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:16.183262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed9d79-9261-4e7b-ae92-df7f031b315c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:16.183530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed9d79-9261-4e7b-ae92-df7f031b315c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:16.190951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed9d79-9261-4e7b-ae92-df7f031b315c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:16.192406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed9d79-9261-4e7b-ae92-df7f031b315c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-70ed9d79-9261-4e7b-ae92-df7f031b315c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:16.205003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:16.205938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:16.207359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:16.207359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:16.207359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:16.207359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:16.207359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:16.207359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:16.207359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:16.207359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:16.207359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 431/849] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:16.214199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9bbcc-491f-4960-a7cd-8212d6481acd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:16.318319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9bbcc-491f-4960-a7cd-8212d6481acd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:16.354336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c988074-6f01-4cf4-a46b-46d4a838098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:16.355406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988074-6f01-4cf4-a46b-46d4a838098e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:16.355899 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988074-6f01-4cf4-a46b-46d4a838098e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:16.356378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988074-6f01-4cf4-a46b-46d4a838098e None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:16.357347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c988074-6f01-4cf4-a46b-46d4a838098e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:16.358070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c988074-6f01-4cf4-a46b-46d4a838098e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:16.359825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c988074-6f01-4cf4-a46b-46d4a838098e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:16.374190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 419/850] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:16.380707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed9d79-9261-4e7b-ae92-df7f031b315c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:16.489661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed9d79-9261-4e7b-ae92-df7f031b315c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:16.491244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:16.527031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808668cf-0b88-4f63-b234-55f9db3ac159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:16.527652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808668cf-0b88-4f63-b234-55f9db3ac159 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:16.527929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808668cf-0b88-4f63-b234-55f9db3ac159 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:16.528206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808668cf-0b88-4f63-b234-55f9db3ac159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:16.529000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808668cf-0b88-4f63-b234-55f9db3ac159 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=b5bb94b71d1c452a88f1594a6b011ca6) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:16.529305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808668cf-0b88-4f63-b234-55f9db3ac159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:16.531352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808668cf-0b88-4f63-b234-55f9db3ac159 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:16.537998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 432/851] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:16 2022] GET /identity/v3/role_assignments?user.id=b5bb94b71d1c452a88f1594a6b011ca6&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=2ba3b2926541436a9d26782420538af3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:16.714751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8bf48-1054-4aaa-accd-8556e1557a16 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:16.715023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8bf48-1054-4aaa-accd-8556e1557a16 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:16.715264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8bf48-1054-4aaa-accd-8556e1557a16 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:16.716615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 420/852] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:16.722533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf480555-0f6f-42ff-8d08-51a2dcc0d087 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:16.722856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf480555-0f6f-42ff-8d08-51a2dcc0d087 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:16.723135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf480555-0f6f-42ff-8d08-51a2dcc0d087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:16.742297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bf480555-0f6f-42ff-8d08-51a2dcc0d087 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:16.743541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bf480555-0f6f-42ff-8d08-51a2dcc0d087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:16.763787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c456e-36e2-42b0-b54c-0e4f41ee50f1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:16.764123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c456e-36e2-42b0-b54c-0e4f41ee50f1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:16.764376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c456e-36e2-42b0-b54c-0e4f41ee50f1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:16.765975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 421/853] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:16.771005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ff579-c5ab-4cab-ae22-ee96145fdfeb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:16.771348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ff579-c5ab-4cab-ae22-ee96145fdfeb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:16.771623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ff579-c5ab-4cab-ae22-ee96145fdfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:16.791379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e45ff579-c5ab-4cab-ae22-ee96145fdfeb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:16.792585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e45ff579-c5ab-4cab-ae22-ee96145fdfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:16.815226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 433/854] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:16.825458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:16.840243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf480555-0f6f-42ff-8d08-51a2dcc0d087 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:16.875864 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 422/855] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:16.899171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ff579-c5ab-4cab-ae22-ee96145fdfeb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:16.948590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:16.956025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf480555-0f6f-42ff-8d08-51a2dcc0d087 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:16.994310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406246e-9eea-4176-b60c-a291a7af9681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:16.994980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406246e-9eea-4176-b60c-a291a7af9681 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:16.995265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406246e-9eea-4176-b60c-a291a7af9681 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:16.995539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406246e-9eea-4176-b60c-a291a7af9681 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.006981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406246e-9eea-4176-b60c-a291a7af9681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5406246e-9eea-4176-b60c-a291a7af9681 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:17.012265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:17.013198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:17.014560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 434/856] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:37:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:17.020932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406246e-9eea-4176-b60c-a291a7af9681 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:17.033003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ff579-c5ab-4cab-ae22-ee96145fdfeb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:17.071532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b55040-2fff-46f0-958f-b30fe5afcb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:17.072419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b55040-2fff-46f0-958f-b30fe5afcb2a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.072766 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b55040-2fff-46f0-958f-b30fe5afcb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.073106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b55040-2fff-46f0-958f-b30fe5afcb2a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.073815 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b55040-2fff-46f0-958f-b30fe5afcb2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:17.075495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b55040-2fff-46f0-958f-b30fe5afcb2a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-60b55040-2fff-46f0-958f-b30fe5afcb2a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:17.085501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:17.087627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:17.089612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 423/857] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jul 27 07:37:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:17.094352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b55040-2fff-46f0-958f-b30fe5afcb2a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:17.129005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:17.145232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406246e-9eea-4176-b60c-a291a7af9681 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:17.183055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b54fc-cb40-4f8c-bcc0-80d0aa94e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:17.184175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b54fc-cb40-4f8c-bcc0-80d0aa94e36c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.184708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b54fc-cb40-4f8c-bcc0-80d0aa94e36c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.185211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b54fc-cb40-4f8c-bcc0-80d0aa94e36c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.186685 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b54fc-cb40-4f8c-bcc0-80d0aa94e36c None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:17.187308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b54fc-cb40-4f8c-bcc0-80d0aa94e36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:17.189173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b54fc-cb40-4f8c-bcc0-80d0aa94e36c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:17.199144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 435/858] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:37:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:17.205164 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b54fc-cb40-4f8c-bcc0-80d0aa94e36c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:17.209920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b55040-2fff-46f0-958f-b30fe5afcb2a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:17.234260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:17.256082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f768-243e-494e-839a-2c5d83529e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:17.256776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f768-243e-494e-839a-2c5d83529e90 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.257159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f768-243e-494e-839a-2c5d83529e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.257535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f768-243e-494e-839a-2c5d83529e90 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.258504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f768-243e-494e-839a-2c5d83529e90 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:17.259705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f768-243e-494e-839a-2c5d83529e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:17.261238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f768-243e-494e-839a-2c5d83529e90 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:17.274349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 424/859] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:17.276372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f768-243e-494e-839a-2c5d83529e90 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:17.335758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b54fc-cb40-4f8c-bcc0-80d0aa94e36c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:17.371839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4eca6-bd05-4cb2-9d39-a42498a7b04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:17.372687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4eca6-bd05-4cb2-9d39-a42498a7b04f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.373072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4eca6-bd05-4cb2-9d39-a42498a7b04f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.373484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4eca6-bd05-4cb2-9d39-a42498a7b04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.383780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:17.384945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4eca6-bd05-4cb2-9d39-a42498a7b04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:17.386594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4eca6-bd05-4cb2-9d39-a42498a7b04f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:17.396904 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f768-243e-494e-839a-2c5d83529e90 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9be4eca6-bd05-4cb2-9d39-a42498a7b04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:17.401758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:17.402868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:17.404019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:17.404019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:17.404019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:17.404019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:17.410314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 436/860] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:17.413274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4eca6-bd05-4cb2-9d39-a42498a7b04f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:17.447011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a6945-dcd8-4db0-bbf7-a3849e9441f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:17.447693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a6945-dcd8-4db0-bbf7-a3849e9441f1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.447975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a6945-dcd8-4db0-bbf7-a3849e9441f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.448250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a6945-dcd8-4db0-bbf7-a3849e9441f1 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.449270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a6945-dcd8-4db0-bbf7-a3849e9441f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:17.449578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a6945-dcd8-4db0-bbf7-a3849e9441f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:17.451162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a6945-dcd8-4db0-bbf7-a3849e9441f1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:17.462928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 425/861] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:17.515398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:17.540396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4eca6-bd05-4cb2-9d39-a42498a7b04f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:17.566174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b0cd6-5648-42a2-9d26-ba499dbaf402 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.566522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b0cd6-5648-42a2-9d26-ba499dbaf402 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.566735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b0cd6-5648-42a2-9d26-ba499dbaf402 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.568428 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 426/862] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:17.574711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355268f-80be-4444-b310-c7829cdca036 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.575322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355268f-80be-4444-b310-c7829cdca036 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.575702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355268f-80be-4444-b310-c7829cdca036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.581460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763ba1d-95bd-4b5a-9655-845d8b192989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:17.582089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763ba1d-95bd-4b5a-9655-845d8b192989 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.582371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763ba1d-95bd-4b5a-9655-845d8b192989 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.582643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763ba1d-95bd-4b5a-9655-845d8b192989 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.583411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763ba1d-95bd-4b5a-9655-845d8b192989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:17.583717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763ba1d-95bd-4b5a-9655-845d8b192989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:17.585120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763ba1d-95bd-4b5a-9655-845d8b192989 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:17.598840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 437/863] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:17.600085 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7355268f-80be-4444-b310-c7829cdca036 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:17.601315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7355268f-80be-4444-b310-c7829cdca036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:17.604360 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763ba1d-95bd-4b5a-9655-845d8b192989 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:17.708247 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 427/864] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:17.721268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763ba1d-95bd-4b5a-9655-845d8b192989 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:17.730147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355268f-80be-4444-b310-c7829cdca036 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:17.758445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:17.766392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231dc67-3420-45fd-8ff4-af391569557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:17.767457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231dc67-3420-45fd-8ff4-af391569557d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.767952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231dc67-3420-45fd-8ff4-af391569557d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.768446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231dc67-3420-45fd-8ff4-af391569557d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.777237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231dc67-3420-45fd-8ff4-af391569557d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:17.779237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231dc67-3420-45fd-8ff4-af391569557d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2231dc67-3420-45fd-8ff4-af391569557d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:17.792561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:17.793520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:17.794458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:17.797816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 438/865] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:37:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:17.804340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231dc67-3420-45fd-8ff4-af391569557d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:17.847324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:17.868144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355268f-80be-4444-b310-c7829cdca036 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:17.915884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf1dde-89ac-4b74-b876-c99fbf7e6de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:17.916519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf1dde-89ac-4b74-b876-c99fbf7e6de9 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.916800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf1dde-89ac-4b74-b876-c99fbf7e6de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.917075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf1dde-89ac-4b74-b876-c99fbf7e6de9 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.918051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf1dde-89ac-4b74-b876-c99fbf7e6de9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:17.919683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf1dde-89ac-4b74-b876-c99fbf7e6de9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:17.927428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231dc67-3420-45fd-8ff4-af391569557d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:17.943246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 428/866] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:37:17 2022] POST /identity/v3/services => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:37:17.979694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6a63c-c899-4e16-8dd2-c90b343eae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:17.980830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6a63c-c899-4e16-8dd2-c90b343eae1a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:17.981345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6a63c-c899-4e16-8dd2-c90b343eae1a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:17.981862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6a63c-c899-4e16-8dd2-c90b343eae1a None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:17.983103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6a63c-c899-4e16-8dd2-c90b343eae1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:17.983649 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6a63c-c899-4e16-8dd2-c90b343eae1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:17.985414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6a63c-c899-4e16-8dd2-c90b343eae1a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:18.007244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 439/867] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 27 07:37:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:18.015726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf1dde-89ac-4b74-b876-c99fbf7e6de9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:18.138302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf1dde-89ac-4b74-b876-c99fbf7e6de9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:18.176919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f164f1-644e-472c-b887-9eb2b769e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:18.177957 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f164f1-644e-472c-b887-9eb2b769e268 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:18.178484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f164f1-644e-472c-b887-9eb2b769e268 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:18.178988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f164f1-644e-472c-b887-9eb2b769e268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:18.195716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:18.257942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f164f1-644e-472c-b887-9eb2b769e268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:18.259447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f164f1-644e-472c-b887-9eb2b769e268 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:18.368095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 429/868] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:18 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:37:18.374188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6a63c-c899-4e16-8dd2-c90b343eae1a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:18.435527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:18.492391 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6a63c-c899-4e16-8dd2-c90b343eae1a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:18.533080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cab23-614c-439c-98c9-60494a383d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:18.534082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cab23-614c-439c-98c9-60494a383d5c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:18.534567 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cab23-614c-439c-98c9-60494a383d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:18.535072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cab23-614c-439c-98c9-60494a383d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:18.546137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cab23-614c-439c-98c9-60494a383d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:18.547961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cab23-614c-439c-98c9-60494a383d5c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-835cab23-614c-439c-98c9-60494a383d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:18.568395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:18.569322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:18.570204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:18.570204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:18.570204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:18.570204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:18.570204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 440/869] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:18.575199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f164f1-644e-472c-b887-9eb2b769e268 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:18.622005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:18.645331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc849e-e9ed-46e5-ad60-ed451281aefc None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:18.645615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc849e-e9ed-46e5-ad60-ed451281aefc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:18.645893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc849e-e9ed-46e5-ad60-ed451281aefc None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:18.647420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 441/870] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:18.652210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a403da-658d-4308-9ba8-53a2e6bd0695 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:18.652572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a403da-658d-4308-9ba8-53a2e6bd0695 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:18.652918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a403da-658d-4308-9ba8-53a2e6bd0695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:18.674257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e9a403da-658d-4308-9ba8-53a2e6bd0695 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:18.676816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e9a403da-658d-4308-9ba8-53a2e6bd0695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:18.689585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f164f1-644e-472c-b887-9eb2b769e268 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:18.738250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9df1-6a0c-422c-84b1-f7370a017b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:18.739591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9df1-6a0c-422c-84b1-f7370a017b28 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:18.740048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9df1-6a0c-422c-84b1-f7370a017b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:18.740518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9df1-6a0c-422c-84b1-f7370a017b28 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:18.741392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc9df1-6a0c-422c-84b1-f7370a017b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:18.742404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc9df1-6a0c-422c-84b1-f7370a017b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:18.744257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc9df1-6a0c-422c-84b1-f7370a017b28 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:18.757333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 442/871] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:18.760611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 430/872] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:18.767920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a403da-658d-4308-9ba8-53a2e6bd0695 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:18.778481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9df1-6a0c-422c-84b1-f7370a017b28 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:18.802767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:18.895787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9df1-6a0c-422c-84b1-f7370a017b28 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:18.899588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:18.909310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a403da-658d-4308-9ba8-53a2e6bd0695 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:18.934638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c166f-c917-4e12-b8da-85552152cb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:18.936089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c166f-c917-4e12-b8da-85552152cb74 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:18.936861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c166f-c917-4e12-b8da-85552152cb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:18.937338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c166f-c917-4e12-b8da-85552152cb74 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:18.938374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c166f-c917-4e12-b8da-85552152cb74 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:18.940680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c166f-c917-4e12-b8da-85552152cb74 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:18.949909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e9f3-eddb-4e05-a113-0c3a90ba4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:18.950548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e9f3-eddb-4e05-a113-0c3a90ba4d0f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:18.952191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e9f3-eddb-4e05-a113-0c3a90ba4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:18.952472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e9f3-eddb-4e05-a113-0c3a90ba4d0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ba2c166f-c917-4e12-b8da-85552152cb74 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:18.953680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:18.954673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:18.955560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:18.959212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 431/873] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:18.963835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c166f-c917-4e12-b8da-85552152cb74 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:18.965463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e9f3-eddb-4e05-a113-0c3a90ba4d0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:18.967701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e9f3-eddb-4e05-a113-0c3a90ba4d0f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3ba3e9f3-eddb-4e05-a113-0c3a90ba4d0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:18.983247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:18.984222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:18.985093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:18.985093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:18.985093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:18.985093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:18.985093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:18.985093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:18.985093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:18.985093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:18.991681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 443/874] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:18.992761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e9f3-eddb-4e05-a113-0c3a90ba4d0f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:19.081498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c166f-c917-4e12-b8da-85552152cb74 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:19.105442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:19.120121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3603c9-46b8-4b2c-8b75-3eb65be31073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:19.120751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3603c9-46b8-4b2c-8b75-3eb65be31073 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:19.121096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3603c9-46b8-4b2c-8b75-3eb65be31073 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:19.121374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3603c9-46b8-4b2c-8b75-3eb65be31073 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:19.122126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3603c9-46b8-4b2c-8b75-3eb65be31073 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:19.122435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3603c9-46b8-4b2c-8b75-3eb65be31073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:19.124172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3603c9-46b8-4b2c-8b75-3eb65be31073 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:19.127332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e9f3-eddb-4e05-a113-0c3a90ba4d0f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:19.134475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 432/875] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:19.135420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3603c9-46b8-4b2c-8b75-3eb65be31073 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:19.169267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db413c-65b8-4acf-ba2a-71116cd95527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:19.171028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db413c-65b8-4acf-ba2a-71116cd95527 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:19.171510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db413c-65b8-4acf-ba2a-71116cd95527 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:19.172165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db413c-65b8-4acf-ba2a-71116cd95527 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:19.173099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db413c-65b8-4acf-ba2a-71116cd95527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:19.173580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db413c-65b8-4acf-ba2a-71116cd95527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:19.173686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:19.176096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db413c-65b8-4acf-ba2a-71116cd95527 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:19.199335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 444/876] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:19.200314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db413c-65b8-4acf-ba2a-71116cd95527 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:19.263292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3603c9-46b8-4b2c-8b75-3eb65be31073 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:19.302549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06935a7-00ef-4f19-ad3e-7294d25f19e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:19.303207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06935a7-00ef-4f19-ad3e-7294d25f19e3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:19.303489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06935a7-00ef-4f19-ad3e-7294d25f19e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:19.303762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06935a7-00ef-4f19-ad3e-7294d25f19e3 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:19.304456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06935a7-00ef-4f19-ad3e-7294d25f19e3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:19.304860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06935a7-00ef-4f19-ad3e-7294d25f19e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:19.306329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06935a7-00ef-4f19-ad3e-7294d25f19e3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:19.308860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db413c-65b8-4acf-ba2a-71116cd95527 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:19.316765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 433/877] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:19.349787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87268de8-38d7-4a51-babe-804c884f7d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:19.350792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87268de8-38d7-4a51-babe-804c884f7d25 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:19.351319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87268de8-38d7-4a51-babe-804c884f7d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:19.351803 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87268de8-38d7-4a51-babe-804c884f7d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:19.352812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87268de8-38d7-4a51-babe-804c884f7d25 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=cc423c22d64144d6aece926a64444e4e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:19.353318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87268de8-38d7-4a51-babe-804c884f7d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:19.355006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87268de8-38d7-4a51-babe-804c884f7d25 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:19.363006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 445/878] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:19 2022] GET /identity/v3/role_assignments?user.id=cc423c22d64144d6aece926a64444e4e&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:19.642916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9aa7-5ed6-4648-8b1b-9767c3056e05 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:19.643451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9aa7-5ed6-4648-8b1b-9767c3056e05 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:19.643451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9aa7-5ed6-4648-8b1b-9767c3056e05 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:19.645076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 434/879] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:19.650409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e6d5-478e-41a1-9c9a-c4ae5c271f08 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:19.650841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e6d5-478e-41a1-9c9a-c4ae5c271f08 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:19.650960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e6d5-478e-41a1-9c9a-c4ae5c271f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:19.669599 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7f43e6d5-478e-41a1-9c9a-c4ae5c271f08 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:19.671414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7f43e6d5-478e-41a1-9c9a-c4ae5c271f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:19.674428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:19.740572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 446/880] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:19.762469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9aa7-5ed6-4648-8b1b-9767c3056e05 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:19.873984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:19.884035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9aa7-5ed6-4648-8b1b-9767c3056e05 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:19.921239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aedd55-6a78-4909-bcde-560cce655bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:19.922210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aedd55-6a78-4909-bcde-560cce655bee None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:19.922674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aedd55-6a78-4909-bcde-560cce655bee None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:19.923159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aedd55-6a78-4909-bcde-560cce655bee None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:19.924060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aedd55-6a78-4909-bcde-560cce655bee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:19.925913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aedd55-6a78-4909-bcde-560cce655bee None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:19.943891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 435/881] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:37:19 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:20.124281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34becf9-2b78-488a-85fe-47cc92a9ab23 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:20.124678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34becf9-2b78-488a-85fe-47cc92a9ab23 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:20.124889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34becf9-2b78-488a-85fe-47cc92a9ab23 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:20.126412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 447/882] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:20.131869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf465a-ab4c-4a23-8ae3-1c8e3784b707 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:20.132157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf465a-ab4c-4a23-8ae3-1c8e3784b707 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:20.132437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf465a-ab4c-4a23-8ae3-1c8e3784b707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:20.151738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bbcf465a-ab4c-4a23-8ae3-1c8e3784b707 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:20.152941 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bbcf465a-ab4c-4a23-8ae3-1c8e3784b707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:20.235117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 436/883] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:20.252517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34becf9-2b78-488a-85fe-47cc92a9ab23 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:20.363083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34becf9-2b78-488a-85fe-47cc92a9ab23 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:20.398420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877b30-1a80-4691-b09e-ec4966a8fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:20.399090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877b30-1a80-4691-b09e-ec4966a8fa61 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:20.399372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877b30-1a80-4691-b09e-ec4966a8fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:20.399637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877b30-1a80-4691-b09e-ec4966a8fa61 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:20.400272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1877b30-1a80-4691-b09e-ec4966a8fa61 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:20.401647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1877b30-1a80-4691-b09e-ec4966a8fa61 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e1877b30-1a80-4691-b09e-ec4966a8fa61 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:20.410809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:20.411825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:20.412996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 448/884] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:37:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:20.425958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf465a-ab4c-4a23-8ae3-1c8e3784b707 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:20.523798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:20.543656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf465a-ab4c-4a23-8ae3-1c8e3784b707 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:20.581229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee07278-3937-4489-94e2-8ffc317f1572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:20.582203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee07278-3937-4489-94e2-8ffc317f1572 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:20.582686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee07278-3937-4489-94e2-8ffc317f1572 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:20.583182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee07278-3937-4489-94e2-8ffc317f1572 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:20.584154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee07278-3937-4489-94e2-8ffc317f1572 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:20.584701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee07278-3937-4489-94e2-8ffc317f1572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:20.586275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee07278-3937-4489-94e2-8ffc317f1572 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:20.596144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 437/885] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:37:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:20.597951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877b30-1a80-4691-b09e-ec4966a8fa61 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:20.603231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:20.709780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877b30-1a80-4691-b09e-ec4966a8fa61 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:20.744858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4e2d-d94b-4b4f-a406-abc0d7660538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:20.745471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4e2d-d94b-4b4f-a406-abc0d7660538 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:20.745797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4e2d-d94b-4b4f-a406-abc0d7660538 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:20.746065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4e2d-d94b-4b4f-a406-abc0d7660538 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:20.746794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4e2d-d94b-4b4f-a406-abc0d7660538 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:20.747129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4e2d-d94b-4b4f-a406-abc0d7660538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:20.748526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4e2d-d94b-4b4f-a406-abc0d7660538 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:20.753879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 449/886] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:37:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:20.759450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee07278-3937-4489-94e2-8ffc317f1572 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:20.868558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee07278-3937-4489-94e2-8ffc317f1572 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:20.907579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581952ae-3bd5-405c-99aa-70cca5c37f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:20.908653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581952ae-3bd5-405c-99aa-70cca5c37f63 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:20.908932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581952ae-3bd5-405c-99aa-70cca5c37f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:20.909202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581952ae-3bd5-405c-99aa-70cca5c37f63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:20.909968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581952ae-3bd5-405c-99aa-70cca5c37f63 None admin] RBAC: Adding query filter params (interface=public, service_id=2f2d50d376434ca1b68088fa8066e4ea, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:20.910272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581952ae-3bd5-405c-99aa-70cca5c37f63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:20.912496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581952ae-3bd5-405c-99aa-70cca5c37f63 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:20.922648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 438/887] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 27 07:37:20 2022] GET /identity/v3/endpoints?service_id=2f2d50d376434ca1b68088fa8066e4ea&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:20.927965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4e2d-d94b-4b4f-a406-abc0d7660538 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:20.998345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:21.035027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4e2d-d94b-4b4f-a406-abc0d7660538 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:21.074598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7f64-bdb5-4518-931c-f7d2819506d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:21.075250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7f64-bdb5-4518-931c-f7d2819506d3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:21.075527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7f64-bdb5-4518-931c-f7d2819506d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:21.075788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7f64-bdb5-4518-931c-f7d2819506d3 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:21.076500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b7f64-bdb5-4518-931c-f7d2819506d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:21.077926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b7f64-bdb5-4518-931c-f7d2819506d3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:21.084198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 450/888] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 27 07:37:20 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:37:21.455980 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7036a-d152-43a9-a040-128fee6f8c32 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:21.456329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7036a-d152-43a9-a040-128fee6f8c32 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:21.456516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7036a-d152-43a9-a040-128fee6f8c32 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:21.458112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 439/889] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:21.463372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035927c1-f852-47bd-8a1e-e4920ead095b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:21.463656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035927c1-f852-47bd-8a1e-e4920ead095b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:21.463931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035927c1-f852-47bd-8a1e-e4920ead095b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:21.482486 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-035927c1-f852-47bd-8a1e-e4920ead095b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:21.484221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-035927c1-f852-47bd-8a1e-e4920ead095b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:21.554956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 451/890] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:21.578344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7036a-d152-43a9-a040-128fee6f8c32 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:21.596898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:21.673762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918605aa-88f0-4e6a-807d-672e6f64ece5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:21.674038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918605aa-88f0-4e6a-807d-672e6f64ece5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:21.674311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918605aa-88f0-4e6a-807d-672e6f64ece5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:21.675693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 452/891] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:21.683822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ca95-9c06-4cb1-929f-29dc7a20076b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:21.684055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ca95-9c06-4cb1-929f-29dc7a20076b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:21.684307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ca95-9c06-4cb1-929f-29dc7a20076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:21.704006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7036a-d152-43a9-a040-128fee6f8c32 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:21.709477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-57b8ca95-9c06-4cb1-929f-29dc7a20076b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:21.710942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-57b8ca95-9c06-4cb1-929f-29dc7a20076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:21.743122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4d184-8f02-4dd1-a776-718a30a8d722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:21.743860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4d184-8f02-4dd1-a776-718a30a8d722 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:21.744139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4d184-8f02-4dd1-a776-718a30a8d722 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:21.744410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4d184-8f02-4dd1-a776-718a30a8d722 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:21.745159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4d184-8f02-4dd1-a776-718a30a8d722 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:21.746561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4d184-8f02-4dd1-a776-718a30a8d722 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:21.770926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 440/892] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:37:21 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:21.790238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:21.809482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 453/893] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:21.833116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4d184-8f02-4dd1-a776-718a30a8d722 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:21.929882 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:21.969204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4d184-8f02-4dd1-a776-718a30a8d722 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.005579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217318f-e0ee-4b39-9258-2cf43c23486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.006238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217318f-e0ee-4b39-9258-2cf43c23486c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.006517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217318f-e0ee-4b39-9258-2cf43c23486c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.006789 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217318f-e0ee-4b39-9258-2cf43c23486c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.018249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217318f-e0ee-4b39-9258-2cf43c23486c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8217318f-e0ee-4b39-9258-2cf43c23486c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:22.023679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:22.024606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:22.025464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 441/894] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 27 07:37:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:22.033394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8ca95-9c06-4cb1-929f-29dc7a20076b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:22.101874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f46c62-84ea-400e-b0ea-a5932a9e1194 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.101874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f46c62-84ea-400e-b0ea-a5932a9e1194 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.101874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f46c62-84ea-400e-b0ea-a5932a9e1194 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.101874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 442/895] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:22.103710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c16fe-7dd5-4e82-bd6f-21a0335c58d4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.103993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c16fe-7dd5-4e82-bd6f-21a0335c58d4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.104268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c16fe-7dd5-4e82-bd6f-21a0335c58d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.125991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eb1c16fe-7dd5-4e82-bd6f-21a0335c58d4 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:22.127786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eb1c16fe-7dd5-4e82-bd6f-21a0335c58d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:22.136865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8ca95-9c06-4cb1-929f-29dc7a20076b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.172074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a3e94-5a88-4972-b870-d0ffc0227b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.172689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a3e94-5a88-4972-b870-d0ffc0227b05 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.172964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a3e94-5a88-4972-b870-d0ffc0227b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.173232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a3e94-5a88-4972-b870-d0ffc0227b05 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.173950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a3e94-5a88-4972-b870-d0ffc0227b05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:22.174252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a3e94-5a88-4972-b870-d0ffc0227b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:22.175640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a3e94-5a88-4972-b870-d0ffc0227b05 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:22.189331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 454/896] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 27 07:37:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:22.190385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a3e94-5a88-4972-b870-d0ffc0227b05 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:22.214948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 443/897] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:22.239041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c16fe-7dd5-4e82-bd6f-21a0335c58d4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:22.259095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:22.318818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a3e94-5a88-4972-b870-d0ffc0227b05 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.322085 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:22.367180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f0760-d2f1-48ed-9405-5794ff851ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.368124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0760-d2f1-48ed-9405-5794ff851ede None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.368552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0760-d2f1-48ed-9405-5794ff851ede None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.368971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0760-d2f1-48ed-9405-5794ff851ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.369254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c16fe-7dd5-4e82-bd6f-21a0335c58d4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.383786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f0760-d2f1-48ed-9405-5794ff851ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:22.386348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f0760-d2f1-48ed-9405-5794ff851ede None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ca9f0760-d2f1-48ed-9405-5794ff851ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:22.406520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:22.407630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:22.408729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:22.408729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:22.408729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:22.408729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:22.409408 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d3959-9d88-4e1d-b649-d43b2c7f943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.410153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d3959-9d88-4e1d-b649-d43b2c7f943c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.410653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d3959-9d88-4e1d-b649-d43b2c7f943c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.411015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d3959-9d88-4e1d-b649-d43b2c7f943c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.411168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 455/898] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:22.411874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d3959-9d88-4e1d-b649-d43b2c7f943c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:22.413314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d3959-9d88-4e1d-b649-d43b2c7f943c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:22.416700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f0760-d2f1-48ed-9405-5794ff851ede None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6c7d3959-9d88-4e1d-b649-d43b2c7f943c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:22.423877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:22.424842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 07:37:22.425656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:22.432299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 444/899] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jul 27 07:37:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:22.433742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d3959-9d88-4e1d-b649-d43b2c7f943c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:22.539284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f0760-d2f1-48ed-9405-5794ff851ede None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.540897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:22.565176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d3959-9d88-4e1d-b649-d43b2c7f943c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.585954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978fa8e-1d0c-4143-9f20-d90561d16385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.587352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978fa8e-1d0c-4143-9f20-d90561d16385 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.587787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978fa8e-1d0c-4143-9f20-d90561d16385 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.588206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978fa8e-1d0c-4143-9f20-d90561d16385 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.589356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978fa8e-1d0c-4143-9f20-d90561d16385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:22.590056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978fa8e-1d0c-4143-9f20-d90561d16385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:22.591350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:22.592650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978fa8e-1d0c-4143-9f20-d90561d16385 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:22.606514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b47f-27e5-4b80-87aa-0dc613f89e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.607246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 456/900] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:22.608313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b47f-27e5-4b80-87aa-0dc613f89e57 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.608743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b47f-27e5-4b80-87aa-0dc613f89e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.609020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b47f-27e5-4b80-87aa-0dc613f89e57 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.609716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4b47f-27e5-4b80-87aa-0dc613f89e57 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:22.610018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4b47f-27e5-4b80-87aa-0dc613f89e57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:22.614698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4b47f-27e5-4b80-87aa-0dc613f89e57 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:22.615965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978fa8e-1d0c-4143-9f20-d90561d16385 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:22.616778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 445/901] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:22.622340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b47f-27e5-4b80-87aa-0dc613f89e57 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:22.729292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978fa8e-1d0c-4143-9f20-d90561d16385 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.765986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b47f-27e5-4b80-87aa-0dc613f89e57 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.767930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276c7c-8650-462c-af4a-cf574fe81690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.768800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276c7c-8650-462c-af4a-cf574fe81690 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.769282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276c7c-8650-462c-af4a-cf574fe81690 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.769774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276c7c-8650-462c-af4a-cf574fe81690 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.778008 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276c7c-8650-462c-af4a-cf574fe81690 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:22.779837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276c7c-8650-462c-af4a-cf574fe81690 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c4276c7c-8650-462c-af4a-cf574fe81690 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:22.792383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:22.793324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:22.794321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:22.801863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 457/902] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:37:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:22.802981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276c7c-8650-462c-af4a-cf574fe81690 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:22.805401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829b8f-b5ac-4875-b433-8e73386f4e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.806033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829b8f-b5ac-4875-b433-8e73386f4e7d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.806316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829b8f-b5ac-4875-b433-8e73386f4e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.806589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829b8f-b5ac-4875-b433-8e73386f4e7d None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.807641 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27829b8f-b5ac-4875-b433-8e73386f4e7d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:22.807946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27829b8f-b5ac-4875-b433-8e73386f4e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:22.810284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27829b8f-b5ac-4875-b433-8e73386f4e7d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:22.818987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 446/903] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:22.823911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829b8f-b5ac-4875-b433-8e73386f4e7d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:22.839231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:22.892782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:22.942818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276c7c-8650-462c-af4a-cf574fe81690 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.948589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829b8f-b5ac-4875-b433-8e73386f4e7d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:22.986939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3852d-c9a6-4c67-a667-f79886f16fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.987879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3852d-c9a6-4c67-a667-f79886f16fcd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.988313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3852d-c9a6-4c67-a667-f79886f16fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.988825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3852d-c9a6-4c67-a667-f79886f16fcd None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.989927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3852d-c9a6-4c67-a667-f79886f16fcd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:22.990353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d9b1-c7d6-412b-95fa-76d2ded04888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:22.990591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3852d-c9a6-4c67-a667-f79886f16fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:22.991029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d9b1-c7d6-412b-95fa-76d2ded04888 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:22.991313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d9b1-c7d6-412b-95fa-76d2ded04888 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:22.991587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d9b1-c7d6-412b-95fa-76d2ded04888 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:22.992381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42d9b1-c7d6-412b-95fa-76d2ded04888 None admin] RBAC: Adding query filter params (interface=public, service_id=f29d7fbdebd04ac58263e903c8ed5d99, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:22.992692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42d9b1-c7d6-412b-95fa-76d2ded04888 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:22.993104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3852d-c9a6-4c67-a667-f79886f16fcd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:22.994092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42d9b1-c7d6-412b-95fa-76d2ded04888 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:23.005637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 447/904] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 27 07:37:22 2022] GET /identity/v3/endpoints?service_id=f29d7fbdebd04ac58263e903c8ed5d99&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:23.007511 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d9b1-c7d6-412b-95fa-76d2ded04888 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:23.022066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 458/905] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 27 07:37:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:23.027317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3852d-c9a6-4c67-a667-f79886f16fcd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:23.147135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:23.152726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d9b1-c7d6-412b-95fa-76d2ded04888 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:23.171992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3852d-c9a6-4c67-a667-f79886f16fcd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:23.177237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:23.199924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc55947-6e9c-4dc5-9106-e1922a9bfe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:23.200565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc55947-6e9c-4dc5-9106-e1922a9bfe0d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.200842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc55947-6e9c-4dc5-9106-e1922a9bfe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.201114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc55947-6e9c-4dc5-9106-e1922a9bfe0d None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.201829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc55947-6e9c-4dc5-9106-e1922a9bfe0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:23.203250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc55947-6e9c-4dc5-9106-e1922a9bfe0d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:23.210338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 448/906] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 27 07:37:23 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:37:23.212076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf4fc-0c08-4059-9ff1-a8ccb2d3c65e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.212566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf4fc-0c08-4059-9ff1-a8ccb2d3c65e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.213039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf4fc-0c08-4059-9ff1-a8ccb2d3c65e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.215064 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 449/907] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:23.221303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e019-0b92-4435-b95e-e0e6c75c7c7d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.221872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e019-0b92-4435-b95e-e0e6c75c7c7d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.222116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e019-0b92-4435-b95e-e0e6c75c7c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.222918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b975-a753-4429-8563-773f55c1f2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:23.223834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b975-a753-4429-8563-773f55c1f2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.224340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b975-a753-4429-8563-773f55c1f2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.224812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b975-a753-4429-8563-773f55c1f2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.242233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a9f4e019-0b92-4435-b95e-e0e6c75c7c7d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:23.243562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a9f4e019-0b92-4435-b95e-e0e6c75c7c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:23.322415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b975-a753-4429-8563-773f55c1f2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:23.324378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b975-a753-4429-8563-773f55c1f2b9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:23.351112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 450/908] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:23.376423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4e019-0b92-4435-b95e-e0e6c75c7c7d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:23.449059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:23.474943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 459/909] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:23 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:37:23.480056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b975-a753-4429-8563-773f55c1f2b9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:23.507740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4e019-0b92-4435-b95e-e0e6c75c7c7d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:23.519928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:23.549955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34951a-2cfc-4bce-9fa5-9a11dd9e7d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:23.550699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34951a-2cfc-4bce-9fa5-9a11dd9e7d24 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.551161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34951a-2cfc-4bce-9fa5-9a11dd9e7d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.551509 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34951a-2cfc-4bce-9fa5-9a11dd9e7d24 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.552331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34951a-2cfc-4bce-9fa5-9a11dd9e7d24 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:23.553881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34951a-2cfc-4bce-9fa5-9a11dd9e7d24 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-db34951a-2cfc-4bce-9fa5-9a11dd9e7d24 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:23.564291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:23.565769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 07:37:23.567187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:23.572721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 451/910] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:37:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:23.574066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34951a-2cfc-4bce-9fa5-9a11dd9e7d24 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:23.613339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b975-a753-4429-8563-773f55c1f2b9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:23.660269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b144b-acd5-4a60-97db-8149a5f06906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:23.660925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b144b-acd5-4a60-97db-8149a5f06906 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.661209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b144b-acd5-4a60-97db-8149a5f06906 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.661486 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b144b-acd5-4a60-97db-8149a5f06906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.675634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b144b-acd5-4a60-97db-8149a5f06906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:23.677621 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b144b-acd5-4a60-97db-8149a5f06906 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:23.692374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34951a-2cfc-4bce-9fa5-9a11dd9e7d24 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-508b144b-acd5-4a60-97db-8149a5f06906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:23.697025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:23.697902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:23.698862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:23.698862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:23.698862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:23.698862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:23.698862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 460/911] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:23.704384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b144b-acd5-4a60-97db-8149a5f06906 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:23.738072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d1dbc-4a69-4b96-b813-0dcfe2d35933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:23.739123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d1dbc-4a69-4b96-b813-0dcfe2d35933 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.739803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d1dbc-4a69-4b96-b813-0dcfe2d35933 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.740284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d1dbc-4a69-4b96-b813-0dcfe2d35933 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.741194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d1dbc-4a69-4b96-b813-0dcfe2d35933 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:23.741708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d1dbc-4a69-4b96-b813-0dcfe2d35933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:23.743303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:23.743906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d1dbc-4a69-4b96-b813-0dcfe2d35933 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:23.750157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 452/912] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:37:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:23.757366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d1dbc-4a69-4b96-b813-0dcfe2d35933 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:23.815294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:23.825536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b144b-acd5-4a60-97db-8149a5f06906 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:23.863819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84345f19-66e5-481f-a1a9-556948fe662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:23.864886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84345f19-66e5-481f-a1a9-556948fe662e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.865371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84345f19-66e5-481f-a1a9-556948fe662e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.865842 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84345f19-66e5-481f-a1a9-556948fe662e None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.866739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84345f19-66e5-481f-a1a9-556948fe662e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:23.867287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84345f19-66e5-481f-a1a9-556948fe662e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:23.868861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84345f19-66e5-481f-a1a9-556948fe662e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:23.886705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 461/913] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:23.888013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84345f19-66e5-481f-a1a9-556948fe662e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:23.890286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d1dbc-4a69-4b96-b813-0dcfe2d35933 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:23.937756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddc748-b2a6-4ab7-a9b7-b0673f494dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:23.938832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddc748-b2a6-4ab7-a9b7-b0673f494dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.939148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddc748-b2a6-4ab7-a9b7-b0673f494dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.939419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddc748-b2a6-4ab7-a9b7-b0673f494dd5 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.940648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddc748-b2a6-4ab7-a9b7-b0673f494dd5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:23.941240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddc748-b2a6-4ab7-a9b7-b0673f494dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:23.943567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddc748-b2a6-4ab7-a9b7-b0673f494dd5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:23.951039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 453/914] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 27 07:37:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:23.952507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9642-0d2f-467c-9e71-6030a99921e1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:23.952851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9642-0d2f-467c-9e71-6030a99921e1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:23.953131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9642-0d2f-467c-9e71-6030a99921e1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:23.954408 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 454/915] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:23.957338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede9642-0d2f-467c-9e71-6030a99921e1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:23.994787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:24.004328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84345f19-66e5-481f-a1a9-556948fe662e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:24.042128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71b07e-cd13-40d5-8883-ff7e5b945b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:24.042774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71b07e-cd13-40d5-8883-ff7e5b945b5a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:24.043083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71b07e-cd13-40d5-8883-ff7e5b945b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:24.043360 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71b07e-cd13-40d5-8883-ff7e5b945b5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:24.051159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71b07e-cd13-40d5-8883-ff7e5b945b5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:24.052609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71b07e-cd13-40d5-8883-ff7e5b945b5a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3a71b07e-cd13-40d5-8883-ff7e5b945b5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:24.064216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:24.065151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:24.066063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:24.066063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:24.066063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:24.066063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:24.066063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:24.066063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:24.066063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:24.066063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:24.066063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 462/916] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:24.066569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac021789-6508-434d-bfed-a81620ee7771 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:24.066978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac021789-6508-434d-bfed-a81620ee7771 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:24.067107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac021789-6508-434d-bfed-a81620ee7771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:24.079223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede9642-0d2f-467c-9e71-6030a99921e1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:24.081364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:24.085067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ac021789-6508-434d-bfed-a81620ee7771 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:24.086292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ac021789-6508-434d-bfed-a81620ee7771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:24.118900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e346ba-fac1-43cc-9cd1-f868aec62a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:24.119546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e346ba-fac1-43cc-9cd1-f868aec62a68 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:24.119824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e346ba-fac1-43cc-9cd1-f868aec62a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:24.120096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e346ba-fac1-43cc-9cd1-f868aec62a68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:24.120809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e346ba-fac1-43cc-9cd1-f868aec62a68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:24.122170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e346ba-fac1-43cc-9cd1-f868aec62a68 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:24.145310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 455/917] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:37:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:37:24.146217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e346ba-fac1-43cc-9cd1-f868aec62a68 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:24.206013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 463/918] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:24.229238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac021789-6508-434d-bfed-a81620ee7771 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:24.324161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e346ba-fac1-43cc-9cd1-f868aec62a68 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:24.352809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:24.374805 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7380bc0-d34e-43b3-88d9-ff04e2f42fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:24.376005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7380bc0-d34e-43b3-88d9-ff04e2f42fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:24.376498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7380bc0-d34e-43b3-88d9-ff04e2f42fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:24.376965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7380bc0-d34e-43b3-88d9-ff04e2f42fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:24.377936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7380bc0-d34e-43b3-88d9-ff04e2f42fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:24.378437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7380bc0-d34e-43b3-88d9-ff04e2f42fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:24.379553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac021789-6508-434d-bfed-a81620ee7771 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:24.380382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7380bc0-d34e-43b3-88d9-ff04e2f42fe3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:24.401467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 456/919] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:24.409470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7380bc0-d34e-43b3-88d9-ff04e2f42fe3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:24.441113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:24.445515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bd5cc-1cd2-43c7-8725-87c14bc2d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:24.446192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bd5cc-1cd2-43c7-8725-87c14bc2d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:24.446474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bd5cc-1cd2-43c7-8725-87c14bc2d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:24.446750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bd5cc-1cd2-43c7-8725-87c14bc2d7f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:24.447436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bd5cc-1cd2-43c7-8725-87c14bc2d7f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:24.448857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bd5cc-1cd2-43c7-8725-87c14bc2d7f6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ff3bd5cc-1cd2-43c7-8725-87c14bc2d7f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:24.461767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:24.463517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:24.464696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 464/920] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:24.472161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bd5cc-1cd2-43c7-8725-87c14bc2d7f6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:24.574923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7380bc0-d34e-43b3-88d9-ff04e2f42fe3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:24.592704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bd5cc-1cd2-43c7-8725-87c14bc2d7f6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:24.624646 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc93442-a512-4c20-8f68-3109909d7088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:24.625715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc93442-a512-4c20-8f68-3109909d7088 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:24.626226 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc93442-a512-4c20-8f68-3109909d7088 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:24.626731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc93442-a512-4c20-8f68-3109909d7088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:24.627812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc93442-a512-4c20-8f68-3109909d7088 None admin] RBAC: Adding query filter params (role.id=62e0df5fca9d4e5189763857170ae97f, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=cc423c22d64144d6aece926a64444e4e) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:24.628128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc93442-a512-4c20-8f68-3109909d7088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:24.629554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc93442-a512-4c20-8f68-3109909d7088 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:24.633290 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4058f0-50bc-4d31-8c2a-9ba5ccc58be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:24.634380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4058f0-50bc-4d31-8c2a-9ba5ccc58be2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:24.634848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4058f0-50bc-4d31-8c2a-9ba5ccc58be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:24.635344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4058f0-50bc-4d31-8c2a-9ba5ccc58be2 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:24.636225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4058f0-50bc-4d31-8c2a-9ba5ccc58be2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:24.636832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4058f0-50bc-4d31-8c2a-9ba5ccc58be2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:24.638385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4058f0-50bc-4d31-8c2a-9ba5ccc58be2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:24.643395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 457/921] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:24 2022] GET /identity/v3/role_assignments?user.id=cc423c22d64144d6aece926a64444e4e&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=62e0df5fca9d4e5189763857170ae97f => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:24.645479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 465/922] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:24.650868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc93442-a512-4c20-8f68-3109909d7088 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:24.748899 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:24.772473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc93442-a512-4c20-8f68-3109909d7088 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:24.811358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd4436-7d24-4ac1-8cb4-904b21c13e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:24.812320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd4436-7d24-4ac1-8cb4-904b21c13e24 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:24.812800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd4436-7d24-4ac1-8cb4-904b21c13e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:24.813267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd4436-7d24-4ac1-8cb4-904b21c13e24 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:24.814141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd4436-7d24-4ac1-8cb4-904b21c13e24 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:24.814635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd4436-7d24-4ac1-8cb4-904b21c13e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:24.816203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd4436-7d24-4ac1-8cb4-904b21c13e24 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:24.822693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 458/923] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:24.831444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4058f0-50bc-4d31-8c2a-9ba5ccc58be2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:24.841722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:24.943773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4058f0-50bc-4d31-8c2a-9ba5ccc58be2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:24.980558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f0667-8519-48e9-bd15-b72828682e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:24.981696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f0667-8519-48e9-bd15-b72828682e0f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:24.982190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f0667-8519-48e9-bd15-b72828682e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:24.983225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f0667-8519-48e9-bd15-b72828682e0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:24.984205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f0667-8519-48e9-bd15-b72828682e0f None admin] RBAC: Adding query filter params (interface=public, service_id=59a3a664e2984baeb8dd9b0bd14a9e90, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:24.984737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f0667-8519-48e9-bd15-b72828682e0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:24.986337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f0667-8519-48e9-bd15-b72828682e0f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:24.995129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 466/924] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 27 07:37:24 2022] GET /identity/v3/endpoints?service_id=59a3a664e2984baeb8dd9b0bd14a9e90&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:25.001299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd4436-7d24-4ac1-8cb4-904b21c13e24 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:25.109317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd4436-7d24-4ac1-8cb4-904b21c13e24 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:25.146630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0763ce-2e56-4230-abd8-8b3595ad93ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:25.147652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0763ce-2e56-4230-abd8-8b3595ad93ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:25.148134 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0763ce-2e56-4230-abd8-8b3595ad93ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:25.148638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0763ce-2e56-4230-abd8-8b3595ad93ae None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:25.149507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0763ce-2e56-4230-abd8-8b3595ad93ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:25.151087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0763ce-2e56-4230-abd8-8b3595ad93ae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:25.157871 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 459/925] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 27 07:37:24 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:37:25.363694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802a14-6efd-4e7d-8447-89bb58452194 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:25.364428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802a14-6efd-4e7d-8447-89bb58452194 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:25.364931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802a14-6efd-4e7d-8447-89bb58452194 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:25.367051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 467/926] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:25.372400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb4273-271f-4850-961b-1350af94c751 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:25.372689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb4273-271f-4850-961b-1350af94c751 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:25.372968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb4273-271f-4850-961b-1350af94c751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:25.392764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a5fb4273-271f-4850-961b-1350af94c751 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:25.394304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a5fb4273-271f-4850-961b-1350af94c751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:25.397613 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:25.467437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 460/927] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:25.493060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b802a14-6efd-4e7d-8447-89bb58452194 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:25.572373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:25.609482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b802a14-6efd-4e7d-8447-89bb58452194 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:25.645407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ff74e-b304-48ca-9129-7230245c257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:25.646016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ff74e-b304-48ca-9129-7230245c257e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:25.646301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ff74e-b304-48ca-9129-7230245c257e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:25.646574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ff74e-b304-48ca-9129-7230245c257e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:25.647239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ff74e-b304-48ca-9129-7230245c257e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:25.648610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ff74e-b304-48ca-9129-7230245c257e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-087ff74e-b304-48ca-9129-7230245c257e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:25.658350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:25.659345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:25.660178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 468/928] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jul 27 07:37:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:25.667904 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb4273-271f-4850-961b-1350af94c751 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:25.775866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb4273-271f-4850-961b-1350af94c751 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:25.812299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907770b-7430-41b6-9717-63c4224203cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:25.812931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907770b-7430-41b6-9717-63c4224203cf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:25.813213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907770b-7430-41b6-9717-63c4224203cf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:25.813487 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907770b-7430-41b6-9717-63c4224203cf None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:25.814172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907770b-7430-41b6-9717-63c4224203cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:25.814475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907770b-7430-41b6-9717-63c4224203cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:25.815875 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907770b-7430-41b6-9717-63c4224203cf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:25.821443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 461/929] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:25.827968 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ff74e-b304-48ca-9129-7230245c257e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:25.953865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ff74e-b304-48ca-9129-7230245c257e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:25.989690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e120853-e725-4fd6-864d-8c1269b14b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:25.990310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e120853-e725-4fd6-864d-8c1269b14b22 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:25.990591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e120853-e725-4fd6-864d-8c1269b14b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:25.990865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e120853-e725-4fd6-864d-8c1269b14b22 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:25.991578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e120853-e725-4fd6-864d-8c1269b14b22 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:25.991880 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e120853-e725-4fd6-864d-8c1269b14b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:25.993271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e120853-e725-4fd6-864d-8c1269b14b22 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:25.994489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:26.000125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 469/930] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:26.005988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907770b-7430-41b6-9717-63c4224203cf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:26.010199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:26.111467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907770b-7430-41b6-9717-63c4224203cf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:26.147572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a285cff-5370-458b-b5ef-c9169a54476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:26.148552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a285cff-5370-458b-b5ef-c9169a54476d None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:26.149041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a285cff-5370-458b-b5ef-c9169a54476d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:26.149521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a285cff-5370-458b-b5ef-c9169a54476d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:26.150481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a285cff-5370-458b-b5ef-c9169a54476d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:26.152090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a285cff-5370-458b-b5ef-c9169a54476d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:26.174482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 462/931] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:37:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:26.313314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3420e-ad02-44da-95e8-de0e521c49eb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:26.313604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3420e-ad02-44da-95e8-de0e521c49eb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:26.313882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3420e-ad02-44da-95e8-de0e521c49eb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:26.315593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 470/932] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:26.321347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397eabe-8a03-4585-86fb-d399c2f6ead5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:26.321865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397eabe-8a03-4585-86fb-d399c2f6ead5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:26.322357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397eabe-8a03-4585-86fb-d399c2f6ead5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:26.343368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7397eabe-8a03-4585-86fb-d399c2f6ead5 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:26.344956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7397eabe-8a03-4585-86fb-d399c2f6ead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:26.407736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:26.426807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 463/933] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:26.449910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3420e-ad02-44da-95e8-de0e521c49eb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:26.559661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3420e-ad02-44da-95e8-de0e521c49eb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:26.596468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:26.597258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:26.597537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:26.597812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:26.598509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:26.600081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:26.602793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WARNING keystone.server.flask.common [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 07:37:26.624145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.sql.core [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 07:37:26.624145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 07:37:26.624145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [parameters: {'id': '687146cf5aef41428d418e8f753adff0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 07:37:26.624145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80296) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 687146cf5aef41428d418e8f753adff0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 687146cf5aef41428d418e8f753adff0. Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application conn.query(q) Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 07:37:26.642928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application result.read() Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 07:37:26.643812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application next(self.gen) Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application yield resource Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application next(self.gen) Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise self.value Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application session.commit() Jul 27 07:37:26.644758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.session.flush() Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application compat.raise_( Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 07:37:26.645642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 07:37:26.646544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application conn.query(q) Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application result.read() Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 07:37:26.648759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [parameters: {'id': '687146cf5aef41428d418e8f753adff0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:26.650817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:26.652669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 687146cf5aef41428d418e8f753adff0. Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:26.655362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 471/934] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Jul 27 07:37:26 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:26.655967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397eabe-8a03-4585-86fb-d399c2f6ead5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:26.766083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397eabe-8a03-4585-86fb-d399c2f6ead5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:26.802578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932937-ed22-4854-acb6-cde654f6db9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:26.803604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932937-ed22-4854-acb6-cde654f6db9e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:26.804075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932937-ed22-4854-acb6-cde654f6db9e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:26.804531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932937-ed22-4854-acb6-cde654f6db9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:26.812259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932937-ed22-4854-acb6-cde654f6db9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:26.813978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932937-ed22-4854-acb6-cde654f6db9e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e0932937-ed22-4854-acb6-cde654f6db9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:26.826184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:26.827562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:26.828455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:26.828455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:26.828455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:26.828455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:26.828455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:26.828455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:26.828455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:26.828455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:26.830708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 464/935] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:26.836864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:26.879621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c99f56-e83d-4fe2-8ab4-5b7784a2a403 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:26.879963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c99f56-e83d-4fe2-8ab4-5b7784a2a403 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:26.880330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c99f56-e83d-4fe2-8ab4-5b7784a2a403 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:26.882067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 465/936] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:26.887414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb9afb-b0fb-4a84-b176-6ce3956b465d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:26.887797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb9afb-b0fb-4a84-b176-6ce3956b465d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:26.888171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb9afb-b0fb-4a84-b176-6ce3956b465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:26.903254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:26.910433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4efb9afb-b0fb-4a84-b176-6ce3956b465d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:26.911994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4efb9afb-b0fb-4a84-b176-6ce3956b465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:26.955767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919314d-6fe6-4dd6-8e7e-65aada8d4142 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:26.964107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:26.993325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 466/937] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:26.995601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e06399-791b-4b47-a6f4-b45061234138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:26.996224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06399-791b-4b47-a6f4-b45061234138 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:26.996505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06399-791b-4b47-a6f4-b45061234138 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:26.996779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06399-791b-4b47-a6f4-b45061234138 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:26.997506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e06399-791b-4b47-a6f4-b45061234138 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:26.997811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e06399-791b-4b47-a6f4-b45061234138 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:27.000118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e06399-791b-4b47-a6f4-b45061234138 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:27.018306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb9afb-b0fb-4a84-b176-6ce3956b465d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:27.024113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 472/938] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:27.133061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb9afb-b0fb-4a84-b176-6ce3956b465d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:27.172518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b094364-e4ff-4c70-bac7-9af7d482a333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:27.173178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b094364-e4ff-4c70-bac7-9af7d482a333 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:27.173457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b094364-e4ff-4c70-bac7-9af7d482a333 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:27.173728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b094364-e4ff-4c70-bac7-9af7d482a333 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:27.184798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b094364-e4ff-4c70-bac7-9af7d482a333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9b094364-e4ff-4c70-bac7-9af7d482a333 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:27.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:27.191304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:27.192163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 467/939] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 27 07:37:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:27.197982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e06399-791b-4b47-a6f4-b45061234138 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:27.210873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326751f-9433-48ae-bbc3-b6d7417f0903 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:27.210873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326751f-9433-48ae-bbc3-b6d7417f0903 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:27.211379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326751f-9433-48ae-bbc3-b6d7417f0903 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:27.213270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 468/940] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:27.218874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4a2d-ad14-41be-9bf1-73205c3cc46f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:27.219170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4a2d-ad14-41be-9bf1-73205c3cc46f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:27.219464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf4a2d-ad14-41be-9bf1-73205c3cc46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:27.243346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ebaf4a2d-ad14-41be-9bf1-73205c3cc46f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:27.244541 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ebaf4a2d-ad14-41be-9bf1-73205c3cc46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:27.278306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:27.328124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e06399-791b-4b47-a6f4-b45061234138 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:27.332688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 469/941] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:27.351276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:27.362094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4a2d-ad14-41be-9bf1-73205c3cc46f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:27.368409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f874-7a52-4f39-bfb8-4d07c021078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:27.369093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f874-7a52-4f39-bfb8-4d07c021078a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:27.369373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f874-7a52-4f39-bfb8-4d07c021078a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:27.369697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f874-7a52-4f39-bfb8-4d07c021078a None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:27.370440 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f874-7a52-4f39-bfb8-4d07c021078a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:27.370744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f874-7a52-4f39-bfb8-4d07c021078a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:27.372269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f874-7a52-4f39-bfb8-4d07c021078a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:27.384077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 473/942] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 27 07:37:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:27.391868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f874-7a52-4f39-bfb8-4d07c021078a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:27.490635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf4a2d-ad14-41be-9bf1-73205c3cc46f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:27.526654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f250-7cfc-468c-a01e-78e9ee947f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:27.527577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f250-7cfc-468c-a01e-78e9ee947f4c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:27.528066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f250-7cfc-468c-a01e-78e9ee947f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:27.528517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f250-7cfc-468c-a01e-78e9ee947f4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:27.529385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8f250-7cfc-468c-a01e-78e9ee947f4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:27.530955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8f250-7cfc-468c-a01e-78e9ee947f4c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:27.536902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f874-7a52-4f39-bfb8-4d07c021078a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-baa8f250-7cfc-468c-a01e-78e9ee947f4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:27.540463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:27.541402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:27.542242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:27.550266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 470/943] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:27.551460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f250-7cfc-468c-a01e-78e9ee947f4c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:27.579091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1afe1-37c2-49b9-ad81-3b5c1c33f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:27.579754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1afe1-37c2-49b9-ad81-3b5c1c33f669 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:27.580028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1afe1-37c2-49b9-ad81-3b5c1c33f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:27.580300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1afe1-37c2-49b9-ad81-3b5c1c33f669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:27.587677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:27.599972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1afe1-37c2-49b9-ad81-3b5c1c33f669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:27.602071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1afe1-37c2-49b9-ad81-3b5c1c33f669 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2fe1afe1-37c2-49b9-ad81-3b5c1c33f669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:27.624836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:27.625792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:27.626667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:27.626667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:27.626667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:27.626667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:27.631008 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 474/944] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:27.632199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1afe1-37c2-49b9-ad81-3b5c1c33f669 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:27.669437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:27.670123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f250-7cfc-468c-a01e-78e9ee947f4c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:27.709542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4019bbc-b9ff-451b-9593-b0e69ade4fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:27.710270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4019bbc-b9ff-451b-9593-b0e69ade4fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:27.710614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4019bbc-b9ff-451b-9593-b0e69ade4fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:27.710979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4019bbc-b9ff-451b-9593-b0e69ade4fa7 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:27.711736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4019bbc-b9ff-451b-9593-b0e69ade4fa7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:27.712098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4019bbc-b9ff-451b-9593-b0e69ade4fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:27.713525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4019bbc-b9ff-451b-9593-b0e69ade4fa7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:27.724203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 471/945] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:27.725116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4019bbc-b9ff-451b-9593-b0e69ade4fa7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:27.761387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1afe1-37c2-49b9-ad81-3b5c1c33f669 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:27.797104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94746d87-19dd-4154-aad9-d27cc53043b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:27.798128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94746d87-19dd-4154-aad9-d27cc53043b5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:27.798611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94746d87-19dd-4154-aad9-d27cc53043b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:27.799124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94746d87-19dd-4154-aad9-d27cc53043b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:27.800026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94746d87-19dd-4154-aad9-d27cc53043b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:27.800529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94746d87-19dd-4154-aad9-d27cc53043b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:27.802122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94746d87-19dd-4154-aad9-d27cc53043b5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:27.818546 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 475/946] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:27.826593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94746d87-19dd-4154-aad9-d27cc53043b5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:27.834303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:27.843124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4019bbc-b9ff-451b-9593-b0e69ade4fa7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:27.881129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f6790-c589-4342-8bfb-b3f2260f50bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:27.881751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f6790-c589-4342-8bfb-b3f2260f50bb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:27.882027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f6790-c589-4342-8bfb-b3f2260f50bb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:27.882304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f6790-c589-4342-8bfb-b3f2260f50bb None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:27.883171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f6790-c589-4342-8bfb-b3f2260f50bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:27.883469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f6790-c589-4342-8bfb-b3f2260f50bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:27.884996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f6790-c589-4342-8bfb-b3f2260f50bb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:27.895217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 472/947] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:27.897022 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f6790-c589-4342-8bfb-b3f2260f50bb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:27.946760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:27.962651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94746d87-19dd-4154-aad9-d27cc53043b5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:28.001472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8e977-7816-4725-855b-4bf0c127b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:28.002270 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8e977-7816-4725-855b-4bf0c127b28d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.002642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8e977-7816-4725-855b-4bf0c127b28d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.003040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8e977-7816-4725-855b-4bf0c127b28d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.011242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8e977-7816-4725-855b-4bf0c127b28d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:28.012824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8e977-7816-4725-855b-4bf0c127b28d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:28.018421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f6790-c589-4342-8bfb-b3f2260f50bb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-74b8e977-7816-4725-855b-4bf0c127b28d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:28.026221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:28.027438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:28.028395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:28.028950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 476/948] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:37:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:28.034009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8e977-7816-4725-855b-4bf0c127b28d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:28.064901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d73d-b693-4188-83cf-0b3dadd0122f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:28.066474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d73d-b693-4188-83cf-0b3dadd0122f None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d73d-b693-4188-83cf-0b3dadd0122f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.067654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d73d-b693-4188-83cf-0b3dadd0122f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.068552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6d73d-b693-4188-83cf-0b3dadd0122f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:28.071070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6d73d-b693-4188-83cf-0b3dadd0122f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:28.095307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 473/949] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:37:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:28.164657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8e977-7816-4725-855b-4bf0c127b28d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:28.212347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37916c92-2fb8-462b-8b35-2dc703b65058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:28.212933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916c92-2fb8-462b-8b35-2dc703b65058 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.213217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916c92-2fb8-462b-8b35-2dc703b65058 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.213558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916c92-2fb8-462b-8b35-2dc703b65058 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.214401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37916c92-2fb8-462b-8b35-2dc703b65058 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:28.214710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37916c92-2fb8-462b-8b35-2dc703b65058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:28.216385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37916c92-2fb8-462b-8b35-2dc703b65058 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:28.243052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 477/950] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 27 07:37:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:28.244945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d73d-b693-4188-83cf-0b3dadd0122f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:28.272948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:28.355500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f3172-8773-4c2a-8d05-de2729f1d2f3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.355783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f3172-8773-4c2a-8d05-de2729f1d2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.356070 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f3172-8773-4c2a-8d05-de2729f1d2f3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.359224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 478/951] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:28.362142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d73d-b693-4188-83cf-0b3dadd0122f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:28.368222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0531157-cd07-4b29-9cd9-0a4905943948 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.368791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0531157-cd07-4b29-9cd9-0a4905943948 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.369314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0531157-cd07-4b29-9cd9-0a4905943948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.377580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:28.395604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d0531157-cd07-4b29-9cd9-0a4905943948 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:28.397820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d0531157-cd07-4b29-9cd9-0a4905943948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:28.400339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bc8f8-174a-4c7c-b062-48a592543daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:28.401066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bc8f8-174a-4c7c-b062-48a592543daf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.401420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bc8f8-174a-4c7c-b062-48a592543daf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.402531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bc8f8-174a-4c7c-b062-48a592543daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.413912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bc8f8-174a-4c7c-b062-48a592543daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:28.415576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bc8f8-174a-4c7c-b062-48a592543daf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ab7bc8f8-174a-4c7c-b062-48a592543daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:28.434383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:28.435542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:28.436434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:28.436434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:28.436434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:28.436434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:28.441444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 474/952] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:28.442284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bc8f8-174a-4c7c-b062-48a592543daf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:28.499224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 479/953] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:28.515612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:28.518705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0531157-cd07-4b29-9cd9-0a4905943948 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:28.553522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bc8f8-174a-4c7c-b062-48a592543daf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:28.589701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d910a-b38b-464f-8718-1e513ff7ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:28.590330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d910a-b38b-464f-8718-1e513ff7ad61 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.590612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d910a-b38b-464f-8718-1e513ff7ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.590900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d910a-b38b-464f-8718-1e513ff7ad61 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.592113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d910a-b38b-464f-8718-1e513ff7ad61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:28.592479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d910a-b38b-464f-8718-1e513ff7ad61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:28.593846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d910a-b38b-464f-8718-1e513ff7ad61 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:28.612599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 475/954] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:28.615589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d910a-b38b-464f-8718-1e513ff7ad61 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:28.648944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0531157-cd07-4b29-9cd9-0a4905943948 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:28.698004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:28.708313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a769f2-ac43-4d3f-89e1-ccec522c37a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:28.709898 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a769f2-ac43-4d3f-89e1-ccec522c37a5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.710255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a769f2-ac43-4d3f-89e1-ccec522c37a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.710613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a769f2-ac43-4d3f-89e1-ccec522c37a5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.711384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a769f2-ac43-4d3f-89e1-ccec522c37a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:28.713026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a769f2-ac43-4d3f-89e1-ccec522c37a5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e9a769f2-ac43-4d3f-89e1-ccec522c37a5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:28.727821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:28.728970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 07:37:28.729856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:28.734969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 480/955] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:28.737653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a769f2-ac43-4d3f-89e1-ccec522c37a5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:28.750244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d910a-b38b-464f-8718-1e513ff7ad61 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:28.781144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:28.792986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1261a-a408-4a28-97ed-1062af2e3e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:28.793670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1261a-a408-4a28-97ed-1062af2e3e51 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.793951 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1261a-a408-4a28-97ed-1062af2e3e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.794225 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1261a-a408-4a28-97ed-1062af2e3e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.802497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1261a-a408-4a28-97ed-1062af2e3e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:28.804109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1261a-a408-4a28-97ed-1062af2e3e51 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-80f1261a-a408-4a28-97ed-1062af2e3e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:28.817475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:28.818521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:28.819455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:28.819455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:28.819455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:28.819455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:28.819455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:28.819455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:28.819455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:28.819455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:28.823807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 476/956] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:28.824795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1261a-a408-4a28-97ed-1062af2e3e51 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:28.876921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a769f2-ac43-4d3f-89e1-ccec522c37a5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:28.915871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df8820-d54f-4e73-8d1b-27483d93489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:28.916982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df8820-d54f-4e73-8d1b-27483d93489a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.917469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df8820-d54f-4e73-8d1b-27483d93489a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.917961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df8820-d54f-4e73-8d1b-27483d93489a None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.918850 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df8820-d54f-4e73-8d1b-27483d93489a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:28.919499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df8820-d54f-4e73-8d1b-27483d93489a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:28.921595 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df8820-d54f-4e73-8d1b-27483d93489a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:28.932595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1261a-a408-4a28-97ed-1062af2e3e51 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:28.933309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 481/957] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:28.934831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df8820-d54f-4e73-8d1b-27483d93489a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:28.969603 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba67a2-5cf8-4f44-85b3-5c9f1e464146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:28.970143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba67a2-5cf8-4f44-85b3-5c9f1e464146 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:28.970427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba67a2-5cf8-4f44-85b3-5c9f1e464146 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:28.970752 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba67a2-5cf8-4f44-85b3-5c9f1e464146 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:28.971901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba67a2-5cf8-4f44-85b3-5c9f1e464146 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:28.972212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba67a2-5cf8-4f44-85b3-5c9f1e464146 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:28.973644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba67a2-5cf8-4f44-85b3-5c9f1e464146 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:28.987075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 477/958] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:28.992648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba67a2-5cf8-4f44-85b3-5c9f1e464146 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:29.004372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:29.045476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:29.053477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df8820-d54f-4e73-8d1b-27483d93489a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:29.092292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cba41-a6cd-455e-b5c3-6a8eb35c17f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:29.093382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cba41-a6cd-455e-b5c3-6a8eb35c17f0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:29.093920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cba41-a6cd-455e-b5c3-6a8eb35c17f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:29.094516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cba41-a6cd-455e-b5c3-6a8eb35c17f0 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:29.095451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cba41-a6cd-455e-b5c3-6a8eb35c17f0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:29.095991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cba41-a6cd-455e-b5c3-6a8eb35c17f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:29.098039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cba41-a6cd-455e-b5c3-6a8eb35c17f0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:29.110915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba67a2-5cf8-4f44-85b3-5c9f1e464146 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:29.111364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 482/959] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:29.145513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426f4da-fa47-4b06-92f7-6b486628de30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:29.146292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f4da-fa47-4b06-92f7-6b486628de30 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:29.146579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f4da-fa47-4b06-92f7-6b486628de30 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:29.146855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f4da-fa47-4b06-92f7-6b486628de30 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/cc423c22d64144d6aece926a64444e4e/roles/62e0df5fca9d4e5189763857170ae97f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:29.149147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426f4da-fa47-4b06-92f7-6b486628de30 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=cc423c22d64144d6aece926a64444e4e, role_id=62e0df5fca9d4e5189763857170ae97f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:29.150682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426f4da-fa47-4b06-92f7-6b486628de30 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:29.168094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 478/960] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:37:28 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/cc423c22d64144d6aece926a64444e4e/roles/62e0df5fca9d4e5189763857170ae97f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:37:29.286853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be2b72-b56e-46df-a7c8-f6913d9d96ac None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:29.287484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be2b72-b56e-46df-a7c8-f6913d9d96ac None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:29.287763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be2b72-b56e-46df-a7c8-f6913d9d96ac None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:29.289421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 483/961] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:29.295947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111773e8-671a-40fb-a85a-90e0fa585442 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:29.296604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111773e8-671a-40fb-a85a-90e0fa585442 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:29.297083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111773e8-671a-40fb-a85a-90e0fa585442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:29.317404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-111773e8-671a-40fb-a85a-90e0fa585442 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:29.319112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-111773e8-671a-40fb-a85a-90e0fa585442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:29.393644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 479/962] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:29.417755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be2b72-b56e-46df-a7c8-f6913d9d96ac None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:29.529574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be2b72-b56e-46df-a7c8-f6913d9d96ac None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:29.555390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:29.566445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:29.567397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:29.567900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:29.568397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:29.569287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:29.570946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:29.587794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.sql.core [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 07:37:29.587794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 07:37:29.587794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [parameters: {'user_id': 'fd6dbf4fa33f4622a5d2e58e3c58e81b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 07:37:29.587794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80296) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application conn.query(q) Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application result.read() Jul 27 07:37:29.597133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 07:37:29.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application next(self.gen) Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application yield resource Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application next(self.gen) Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise self.value Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application session.commit() Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 07:37:29.599210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.session.flush() Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application compat.raise_( Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 07:37:29.600145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 07:37:29.601061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application conn.query(q) Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application result.read() Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 07:37:29.601928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fd6dbf4fa33f4622a5d2e58e3c58e81b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:29.602742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 07:37:29.605639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 07:37:29.608417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 07:37:29.608417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 07:37:29.608417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 07:37:29.608417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 07:37:29.608417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 07:37:29.608417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:29.610691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 484/963] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 27 07:37:29 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:29.616903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111773e8-671a-40fb-a85a-90e0fa585442 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:29.659046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:29.737112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111773e8-671a-40fb-a85a-90e0fa585442 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:29.776428 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40c07d-a41f-495e-9299-e3fbf827d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:29.777497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40c07d-a41f-495e-9299-e3fbf827d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:29.777985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40c07d-a41f-495e-9299-e3fbf827d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:29.778461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40c07d-a41f-495e-9299-e3fbf827d1e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:29.787074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40c07d-a41f-495e-9299-e3fbf827d1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:29.788814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40c07d-a41f-495e-9299-e3fbf827d1e6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9a40c07d-a41f-495e-9299-e3fbf827d1e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:29.801986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:29.802967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 07:37:29.803998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:29.806711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 480/964] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:37:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:29.818940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:29.929376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dde34-ddb0-4a37-b186-277d914b6db6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:29.963950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf42b3-64a6-4105-8347-72b74bb9ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:29.964574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf42b3-64a6-4105-8347-72b74bb9ace2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:29.964853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf42b3-64a6-4105-8347-72b74bb9ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:29.965123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf42b3-64a6-4105-8347-72b74bb9ace2 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:29.965894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf42b3-64a6-4105-8347-72b74bb9ace2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:29.966194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf42b3-64a6-4105-8347-72b74bb9ace2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:29.968467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf42b3-64a6-4105-8347-72b74bb9ace2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:30.012624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 485/965] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 27 07:37:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:30.201300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fac96-922d-4714-a09f-059cc69e08ed None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:30.201846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fac96-922d-4714-a09f-059cc69e08ed None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:30.201846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fac96-922d-4714-a09f-059cc69e08ed None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:30.203527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 481/966] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:30.209101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7bb1d-50f1-4027-8a67-a90b71087989 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:30.209387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7bb1d-50f1-4027-8a67-a90b71087989 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:30.209659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7bb1d-50f1-4027-8a67-a90b71087989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:30.230340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-75a7bb1d-50f1-4027-8a67-a90b71087989 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:30.231902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-75a7bb1d-50f1-4027-8a67-a90b71087989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:30.279832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:30.309378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 486/967] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:30.331978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fac96-922d-4714-a09f-059cc69e08ed None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:30.436381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:30.444128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fac96-922d-4714-a09f-059cc69e08ed None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:30.478869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b5e0-e145-40b6-837d-02e4da00b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:30.479480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b5e0-e145-40b6-837d-02e4da00b429 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:30.479762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b5e0-e145-40b6-837d-02e4da00b429 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:30.480036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b5e0-e145-40b6-837d-02e4da00b429 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:30.480675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b5e0-e145-40b6-837d-02e4da00b429 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:30.482043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b5e0-e145-40b6-837d-02e4da00b429 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0149b5e0-e145-40b6-837d-02e4da00b429 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:30.491563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:30.492569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:30.493459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 482/968] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:30.500828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7bb1d-50f1-4027-8a67-a90b71087989 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:30.599456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7bb1d-50f1-4027-8a67-a90b71087989 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:30.633481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03533-c017-41e7-9cc7-ccb8d1e47469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:30.634096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03533-c017-41e7-9cc7-ccb8d1e47469 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:30.634379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03533-c017-41e7-9cc7-ccb8d1e47469 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:30.634654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03533-c017-41e7-9cc7-ccb8d1e47469 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:30.635379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03533-c017-41e7-9cc7-ccb8d1e47469 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:30.635686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03533-c017-41e7-9cc7-ccb8d1e47469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:30.637060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03533-c017-41e7-9cc7-ccb8d1e47469 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:30.647019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 487/969] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:30.648250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b5e0-e145-40b6-837d-02e4da00b429 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:30.749147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b5e0-e145-40b6-837d-02e4da00b429 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:30.785764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd361de9-6c50-4303-b2c6-3f5711b706a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:30.786386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd361de9-6c50-4303-b2c6-3f5711b706a8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:30.786667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd361de9-6c50-4303-b2c6-3f5711b706a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:30.787014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd361de9-6c50-4303-b2c6-3f5711b706a8 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:30.787657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd361de9-6c50-4303-b2c6-3f5711b706a8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:30.787962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd361de9-6c50-4303-b2c6-3f5711b706a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:30.789330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd361de9-6c50-4303-b2c6-3f5711b706a8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:30.794541 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 483/970] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:30.800868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03533-c017-41e7-9cc7-ccb8d1e47469 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:30.847453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:30.912623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03533-c017-41e7-9cc7-ccb8d1e47469 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:30.947143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31004d79-4cbf-48d7-a80f-8ac76c8b5b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:30.947759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31004d79-4cbf-48d7-a80f-8ac76c8b5b13 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:30.948041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31004d79-4cbf-48d7-a80f-8ac76c8b5b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:30.948313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31004d79-4cbf-48d7-a80f-8ac76c8b5b13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:30.949082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31004d79-4cbf-48d7-a80f-8ac76c8b5b13 None admin] RBAC: Adding query filter params (interface=admin, service_id=59a3a664e2984baeb8dd9b0bd14a9e90, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:30.949392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31004d79-4cbf-48d7-a80f-8ac76c8b5b13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:30.950754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31004d79-4cbf-48d7-a80f-8ac76c8b5b13 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:30.961118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 488/971] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Jul 27 07:37:30 2022] GET /identity/v3/endpoints?service_id=59a3a664e2984baeb8dd9b0bd14a9e90&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:30.962108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd361de9-6c50-4303-b2c6-3f5711b706a8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:30.988365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:31.065499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd361de9-6c50-4303-b2c6-3f5711b706a8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:31.099856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5494d-505e-4cd5-b597-31d88dddefe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:31.100447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5494d-505e-4cd5-b597-31d88dddefe7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:31.100761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5494d-505e-4cd5-b597-31d88dddefe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:31.101001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5494d-505e-4cd5-b597-31d88dddefe7 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:31.101691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5494d-505e-4cd5-b597-31d88dddefe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:31.103063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5494d-505e-4cd5-b597-31d88dddefe7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:31.115130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 484/972] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 27 07:37:30 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:37:31.259025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556bef5-4e8c-4b6f-87d5-9afccc3fc2eb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:31.259566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556bef5-4e8c-4b6f-87d5-9afccc3fc2eb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:31.259566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556bef5-4e8c-4b6f-87d5-9afccc3fc2eb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:31.260916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 489/973] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:31.266806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e66b8-1dbc-40d7-903f-410f7e24f714 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:31.267265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e66b8-1dbc-40d7-903f-410f7e24f714 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:31.267395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e66b8-1dbc-40d7-903f-410f7e24f714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:31.286359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-501e66b8-1dbc-40d7-903f-410f7e24f714 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:31.287883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-501e66b8-1dbc-40d7-903f-410f7e24f714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:31.304260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf738fd-fe4c-4194-9d2e-a7e6035235ea None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:31.304646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf738fd-fe4c-4194-9d2e-a7e6035235ea None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:31.304802 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf738fd-fe4c-4194-9d2e-a7e6035235ea None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:31.306280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 490/974] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:31.311439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaecd92-abbb-43d4-8c70-02cc306fef5e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:31.311716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaecd92-abbb-43d4-8c70-02cc306fef5e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:31.311986 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaecd92-abbb-43d4-8c70-02cc306fef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:31.330134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4eaecd92-abbb-43d4-8c70-02cc306fef5e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:31.331273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4eaecd92-abbb-43d4-8c70-02cc306fef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:31.365813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 485/975] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:31.387888 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e66b8-1dbc-40d7-903f-410f7e24f714 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:31.405366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 491/976] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:31.408424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:31.429482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaecd92-abbb-43d4-8c70-02cc306fef5e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:31.464555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:31.509194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e66b8-1dbc-40d7-903f-410f7e24f714 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:31.541234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaecd92-abbb-43d4-8c70-02cc306fef5e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:31.545255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f1584-c2ad-4939-b6aa-9c9239586e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:31.545970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f1584-c2ad-4939-b6aa-9c9239586e2f None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:31.546243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f1584-c2ad-4939-b6aa-9c9239586e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:31.546511 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f1584-c2ad-4939-b6aa-9c9239586e2f None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:31.547236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f1584-c2ad-4939-b6aa-9c9239586e2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:31.548620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f1584-c2ad-4939-b6aa-9c9239586e2f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:31.565025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 486/977] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:37:31 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:37:31.588430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19ccf7-7819-4808-a3b1-960ea0450fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:31.589072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19ccf7-7819-4808-a3b1-960ea0450fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:31.589352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19ccf7-7819-4808-a3b1-960ea0450fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:31.589622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19ccf7-7819-4808-a3b1-960ea0450fd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:31.602139 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19ccf7-7819-4808-a3b1-960ea0450fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bf19ccf7-7819-4808-a3b1-960ea0450fd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:31.607240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:31.608242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:31.609174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:31.613670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 492/978] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 27 07:37:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:31.614597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f1584-c2ad-4939-b6aa-9c9239586e2f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:31.705401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:31.733125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f1584-c2ad-4939-b6aa-9c9239586e2f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:31.767490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f0180-e1a0-48e3-994e-239680f7fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:31.768130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f0180-e1a0-48e3-994e-239680f7fc5d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:31.768405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f0180-e1a0-48e3-994e-239680f7fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:31.768669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f0180-e1a0-48e3-994e-239680f7fc5d None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:31.769387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f0180-e1a0-48e3-994e-239680f7fc5d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:31.769684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f0180-e1a0-48e3-994e-239680f7fc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:31.771071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f0180-e1a0-48e3-994e-239680f7fc5d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:31.779469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 487/979] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 27 07:37:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:31.785877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19ccf7-7819-4808-a3b1-960ea0450fd6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:31.879038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:31.901221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19ccf7-7819-4808-a3b1-960ea0450fd6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:31.936933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644565-220f-43de-bdd6-1ba744970bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:31.937584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644565-220f-43de-bdd6-1ba744970bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:31.937845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644565-220f-43de-bdd6-1ba744970bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:31.938110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644565-220f-43de-bdd6-1ba744970bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:31.948500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1644565-220f-43de-bdd6-1ba744970bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:31.950138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1644565-220f-43de-bdd6-1ba744970bb5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c1644565-220f-43de-bdd6-1ba744970bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:31.965084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:31.966058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:31.967078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:31.967078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:31.967078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:31.967078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:31.967078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 493/980] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:31.972336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f0180-e1a0-48e3-994e-239680f7fc5d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:32.078606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f0180-e1a0-48e3-994e-239680f7fc5d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:32.114995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9413f-61dc-4f8f-a365-279adf624cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:32.115626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9413f-61dc-4f8f-a365-279adf624cef None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:32.115910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9413f-61dc-4f8f-a365-279adf624cef None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:32.116184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9413f-61dc-4f8f-a365-279adf624cef None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:32.116931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9413f-61dc-4f8f-a365-279adf624cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:32.117241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9413f-61dc-4f8f-a365-279adf624cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:32.118610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9413f-61dc-4f8f-a365-279adf624cef None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:32.128010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:32.139207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 488/981] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:32.140235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644565-220f-43de-bdd6-1ba744970bb5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:32.253716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644565-220f-43de-bdd6-1ba744970bb5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:32.289506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44600a2-59fc-405d-8faf-38ff19286ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:32.291019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44600a2-59fc-405d-8faf-38ff19286ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:32.291529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44600a2-59fc-405d-8faf-38ff19286ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:32.292007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44600a2-59fc-405d-8faf-38ff19286ba4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:32.300312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44600a2-59fc-405d-8faf-38ff19286ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:32.302040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44600a2-59fc-405d-8faf-38ff19286ba4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:32.304895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a44600a2-59fc-405d-8faf-38ff19286ba4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:32.316458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:32.317424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 07:37:32.318374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:32.319726 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 494/982] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:37:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:32.323950 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9413f-61dc-4f8f-a365-279adf624cef None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:32.436102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9413f-61dc-4f8f-a365-279adf624cef None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:32.471133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bea1b7-38e4-41a8-8ea0-0cdb4067fa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:32.471992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bea1b7-38e4-41a8-8ea0-0cdb4067fa82 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:32.472262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bea1b7-38e4-41a8-8ea0-0cdb4067fa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:32.472524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bea1b7-38e4-41a8-8ea0-0cdb4067fa82 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:32.473362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bea1b7-38e4-41a8-8ea0-0cdb4067fa82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:32.473702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bea1b7-38e4-41a8-8ea0-0cdb4067fa82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:32.475145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bea1b7-38e4-41a8-8ea0-0cdb4067fa82 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:32.492605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 489/983] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 27 07:37:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:32.498973 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44600a2-59fc-405d-8faf-38ff19286ba4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:32.600798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44600a2-59fc-405d-8faf-38ff19286ba4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:32.634593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6176e-cfa5-4a93-9424-173df620f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:32.635240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6176e-cfa5-4a93-9424-173df620f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:32.635521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6176e-cfa5-4a93-9424-173df620f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:32.635791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6176e-cfa5-4a93-9424-173df620f6d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:32.706793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:32.709572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6176e-cfa5-4a93-9424-173df620f6d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:32.711152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6176e-cfa5-4a93-9424-173df620f6d2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:32.815847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 495/984] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:32 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:37:32.821422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bea1b7-38e4-41a8-8ea0-0cdb4067fa82 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:32.881021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:32.933440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bea1b7-38e4-41a8-8ea0-0cdb4067fa82 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:32.968323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4c5ec-9cf2-4913-832b-753250db3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:32.968893 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4c5ec-9cf2-4913-832b-753250db3f0b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:32.969172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4c5ec-9cf2-4913-832b-753250db3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:32.969445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4c5ec-9cf2-4913-832b-753250db3f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:32.980170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4c5ec-9cf2-4913-832b-753250db3f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:32.981628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4c5ec-9cf2-4913-832b-753250db3f0b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c5a4c5ec-9cf2-4913-832b-753250db3f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:32.996157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:32.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:32.998454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:32.998454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:32.998454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:32.998454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:33.002491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 490/985] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:33.003888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6176e-cfa5-4a93-9424-173df620f6d2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:33.108521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:33.112937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6176e-cfa5-4a93-9424-173df620f6d2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:33.148858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a140ff-0e7b-4b69-9f2e-46b388fc2bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:33.149480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a140ff-0e7b-4b69-9f2e-46b388fc2bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.149763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a140ff-0e7b-4b69-9f2e-46b388fc2bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.150038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a140ff-0e7b-4b69-9f2e-46b388fc2bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.150733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a140ff-0e7b-4b69-9f2e-46b388fc2bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:33.151079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a140ff-0e7b-4b69-9f2e-46b388fc2bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:33.152450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a140ff-0e7b-4b69-9f2e-46b388fc2bc4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:33.156857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa770d48-f74b-4a4b-8680-fd80e99d7427 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.157139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa770d48-f74b-4a4b-8680-fd80e99d7427 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.157413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa770d48-f74b-4a4b-8680-fd80e99d7427 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.158933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 491/986] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:33.163892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aa426-9569-4d05-9255-29a60fc77318 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.164181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aa426-9569-4d05-9255-29a60fc77318 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.164458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aa426-9569-4d05-9255-29a60fc77318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.169285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 496/987] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:33.170390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a140ff-0e7b-4b69-9f2e-46b388fc2bc4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:33.183362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-496aa426-9569-4d05-9255-29a60fc77318 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:33.184672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-496aa426-9569-4d05-9255-29a60fc77318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:33.254531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 492/988] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:33.277526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aa426-9569-4d05-9255-29a60fc77318 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:33.282000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a140ff-0e7b-4b69-9f2e-46b388fc2bc4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:33.322778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f49cfa-4574-42cd-b57b-5d0c9ab07ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:33.323458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f49cfa-4574-42cd-b57b-5d0c9ab07ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.323723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f49cfa-4574-42cd-b57b-5d0c9ab07ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.324305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f49cfa-4574-42cd-b57b-5d0c9ab07ca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.324783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:33.332141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f49cfa-4574-42cd-b57b-5d0c9ab07ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:33.333605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f49cfa-4574-42cd-b57b-5d0c9ab07ca4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-70f49cfa-4574-42cd-b57b-5d0c9ab07ca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:33.345307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:33.346276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:33.347482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:33.347482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:33.347482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:33.347482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:33.347482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:33.347482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:33.347482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:33.347482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:33.347482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 497/989] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:33.352547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f49cfa-4574-42cd-b57b-5d0c9ab07ca4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:33.379245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:33.395009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aa426-9569-4d05-9255-29a60fc77318 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:33.437352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a99cf-7091-4c7f-b14e-02997323daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:33.438008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a99cf-7091-4c7f-b14e-02997323daa9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.438292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a99cf-7091-4c7f-b14e-02997323daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.438563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a99cf-7091-4c7f-b14e-02997323daa9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.439240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a99cf-7091-4c7f-b14e-02997323daa9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:33.440637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a99cf-7091-4c7f-b14e-02997323daa9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-027a99cf-7091-4c7f-b14e-02997323daa9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:33.449974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:33.451084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:33.451983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 493/990] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 27 07:37:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:33.457416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a99cf-7091-4c7f-b14e-02997323daa9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:33.476010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f49cfa-4574-42cd-b57b-5d0c9ab07ca4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:33.514191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7d1fa-7cbd-4a75-afe7-57c50fe61529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:33.514713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7d1fa-7cbd-4a75-afe7-57c50fe61529 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.515021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7d1fa-7cbd-4a75-afe7-57c50fe61529 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.515405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7d1fa-7cbd-4a75-afe7-57c50fe61529 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.516282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7d1fa-7cbd-4a75-afe7-57c50fe61529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:33.516585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7d1fa-7cbd-4a75-afe7-57c50fe61529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:33.518146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7d1fa-7cbd-4a75-afe7-57c50fe61529 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:33.531977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 498/991] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:33.537649 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7d1fa-7cbd-4a75-afe7-57c50fe61529 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:33.565539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a99cf-7091-4c7f-b14e-02997323daa9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:33.569010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:33.603588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7339f59-54c3-44c8-8b87-0dbbc5d554d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:33.604220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7339f59-54c3-44c8-8b87-0dbbc5d554d1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.604511 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7339f59-54c3-44c8-8b87-0dbbc5d554d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.604787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7339f59-54c3-44c8-8b87-0dbbc5d554d1 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.605475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7339f59-54c3-44c8-8b87-0dbbc5d554d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:33.605777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7339f59-54c3-44c8-8b87-0dbbc5d554d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:33.607211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7339f59-54c3-44c8-8b87-0dbbc5d554d1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:33.612228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 494/992] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:33.617874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7339f59-54c3-44c8-8b87-0dbbc5d554d1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:33.632746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:33.658003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7d1fa-7cbd-4a75-afe7-57c50fe61529 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:33.695641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c30bf-b304-4378-a268-8ec8c9963b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:33.696263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c30bf-b304-4378-a268-8ec8c9963b5a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.696537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c30bf-b304-4378-a268-8ec8c9963b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.696807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c30bf-b304-4378-a268-8ec8c9963b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.697601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c30bf-b304-4378-a268-8ec8c9963b5a None admin] RBAC: Adding query filter params (role.id=62e0df5fca9d4e5189763857170ae97f, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=cc423c22d64144d6aece926a64444e4e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:33.697908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c30bf-b304-4378-a268-8ec8c9963b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:33.699405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c30bf-b304-4378-a268-8ec8c9963b5a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:33.705714 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 499/993] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:33 2022] GET /identity/v3/role_assignments?user.id=cc423c22d64144d6aece926a64444e4e&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=62e0df5fca9d4e5189763857170ae97f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:33.706774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71a6c1-189a-4889-aeeb-c3bea7b2bba3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.707082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71a6c1-189a-4889-aeeb-c3bea7b2bba3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.707357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71a6c1-189a-4889-aeeb-c3bea7b2bba3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.708600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 500/994] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:33.714537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0b0e-000b-4428-802d-a28b39366b5b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.714811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0b0e-000b-4428-802d-a28b39366b5b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.715106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0b0e-000b-4428-802d-a28b39366b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.734774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7339f59-54c3-44c8-8b87-0dbbc5d554d1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:33.736603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0d6a0b0e-000b-4428-802d-a28b39366b5b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:33.737961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0d6a0b0e-000b-4428-802d-a28b39366b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:33.778742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7486b2-beec-46ee-8839-4c1de78f47ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:33.780174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7486b2-beec-46ee-8839-4c1de78f47ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.780630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7486b2-beec-46ee-8839-4c1de78f47ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.781063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7486b2-beec-46ee-8839-4c1de78f47ae None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.781916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7486b2-beec-46ee-8839-4c1de78f47ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:33.782370 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7486b2-beec-46ee-8839-4c1de78f47ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:33.783960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7486b2-beec-46ee-8839-4c1de78f47ae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:33.791168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 495/995] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 27 07:37:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:33.797792 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7486b2-beec-46ee-8839-4c1de78f47ae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:33.829372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 501/996] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:33.840934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:33.853401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a0b0e-000b-4428-802d-a28b39366b5b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:33.914476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7486b2-beec-46ee-8839-4c1de78f47ae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:33.952377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:33.955713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e97a4-a783-4766-8515-cebdbc3e658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:33.956336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e97a4-a783-4766-8515-cebdbc3e658d None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:33.956619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e97a4-a783-4766-8515-cebdbc3e658d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:33.956885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e97a4-a783-4766-8515-cebdbc3e658d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:33.957610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e97a4-a783-4766-8515-cebdbc3e658d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:33.959036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e97a4-a783-4766-8515-cebdbc3e658d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:33.976530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 496/997] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:37:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:37:33.986448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a0b0e-000b-4428-802d-a28b39366b5b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:34.035119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7d475-2309-4e82-9120-d6a9dd42231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:34.035692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7d475-2309-4e82-9120-d6a9dd42231a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:34.035966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7d475-2309-4e82-9120-d6a9dd42231a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:34.036233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7d475-2309-4e82-9120-d6a9dd42231a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:34.036873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7d475-2309-4e82-9120-d6a9dd42231a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:34.038334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7d475-2309-4e82-9120-d6a9dd42231a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b2b7d475-2309-4e82-9120-d6a9dd42231a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:34.052703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:34.053854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 07:37:34.054691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:34.056318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 502/998] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:34.060385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e97a4-a783-4766-8515-cebdbc3e658d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:34.164893 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:34.175397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e97a4-a783-4766-8515-cebdbc3e658d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:34.218152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464f119-ccb1-4b23-8550-f867c86bd775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:34.218802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464f119-ccb1-4b23-8550-f867c86bd775 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:34.219117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464f119-ccb1-4b23-8550-f867c86bd775 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:34.219403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464f119-ccb1-4b23-8550-f867c86bd775 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:34.220111 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464f119-ccb1-4b23-8550-f867c86bd775 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:34.220419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464f119-ccb1-4b23-8550-f867c86bd775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:34.222065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464f119-ccb1-4b23-8550-f867c86bd775 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:34.227531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 497/999] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:34.234024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7d475-2309-4e82-9120-d6a9dd42231a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:34.338045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7d475-2309-4e82-9120-d6a9dd42231a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:34.377283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7c0b3-7afa-4e21-85f5-a84554f4040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:34.377903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7c0b3-7afa-4e21-85f5-a84554f4040a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:34.378188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7c0b3-7afa-4e21-85f5-a84554f4040a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:34.378463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7c0b3-7afa-4e21-85f5-a84554f4040a None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:34.379179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7c0b3-7afa-4e21-85f5-a84554f4040a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:34.379487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7c0b3-7afa-4e21-85f5-a84554f4040a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:34.380864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7c0b3-7afa-4e21-85f5-a84554f4040a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:34.382139 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:34.387732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 503/1000] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:34.393398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464f119-ccb1-4b23-8550-f867c86bd775 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:34.509346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464f119-ccb1-4b23-8550-f867c86bd775 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:34.542663 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e54539-5648-4c92-9e31-7977fac30ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:34.543314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e54539-5648-4c92-9e31-7977fac30ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:34.543595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e54539-5648-4c92-9e31-7977fac30ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:34.543863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e54539-5648-4c92-9e31-7977fac30ab9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:34.545220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e54539-5648-4c92-9e31-7977fac30ab9 None admin] RBAC: Adding query filter params (interface=public, service_id=fcb9d213c2354719964b478151288854, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:34.545531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e54539-5648-4c92-9e31-7977fac30ab9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:34.546913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e54539-5648-4c92-9e31-7977fac30ab9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:34.556405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 498/1001] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 27 07:37:34 2022] GET /identity/v3/endpoints?service_id=fcb9d213c2354719964b478151288854&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:34.557564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7c0b3-7afa-4e21-85f5-a84554f4040a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:34.660283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7c0b3-7afa-4e21-85f5-a84554f4040a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:34.694034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa350ab-8ec5-4838-ba89-97209cefc109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:34.694647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa350ab-8ec5-4838-ba89-97209cefc109 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:34.694953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa350ab-8ec5-4838-ba89-97209cefc109 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:34.695231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa350ab-8ec5-4838-ba89-97209cefc109 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:34.695889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa350ab-8ec5-4838-ba89-97209cefc109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:34.697257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa350ab-8ec5-4838-ba89-97209cefc109 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:34.704106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 504/1002] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 27 07:37:34 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:37:35.823931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89016-bc91-489b-a8e3-44c07a5ef50d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:35.824472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89016-bc91-489b-a8e3-44c07a5ef50d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:35.824472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89016-bc91-489b-a8e3-44c07a5ef50d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:35.826712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 499/1003] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:35.832859 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cecf8-5637-44d9-9d3d-4cb9627acc38 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:35.833349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cecf8-5637-44d9-9d3d-4cb9627acc38 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:35.833448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cecf8-5637-44d9-9d3d-4cb9627acc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:35.851696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-083cecf8-5637-44d9-9d3d-4cb9627acc38 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:35.852886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-083cecf8-5637-44d9-9d3d-4cb9627acc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:35.911243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:35.923175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 505/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:35.944505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd89016-bc91-489b-a8e3-44c07a5ef50d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:35.967223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:36.049639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd89016-bc91-489b-a8e3-44c07a5ef50d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:36.076726 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc60da-8efa-4d28-ab28-768193aaaa88 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:36.076921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc60da-8efa-4d28-ab28-768193aaaa88 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:36.077141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc60da-8efa-4d28-ab28-768193aaaa88 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:36.078710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 506/1005] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:36.083442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99418f57-f01d-4858-92b0-db68feae57c8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:36.083734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99418f57-f01d-4858-92b0-db68feae57c8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:36.084047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99418f57-f01d-4858-92b0-db68feae57c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:36.085226 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69723c28-11ff-42a8-b257-8269e3d63cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:36.085874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69723c28-11ff-42a8-b257-8269e3d63cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:36.086153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69723c28-11ff-42a8-b257-8269e3d63cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:36.086422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69723c28-11ff-42a8-b257-8269e3d63cb0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:36.087098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69723c28-11ff-42a8-b257-8269e3d63cb0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:36.088458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69723c28-11ff-42a8-b257-8269e3d63cb0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-69723c28-11ff-42a8-b257-8269e3d63cb0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:36.098784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:36.100115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 07:37:36.100974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:36.103218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 500/1006] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jul 27 07:37:35 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:36.103845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-99418f57-f01d-4858-92b0-db68feae57c8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:36.105079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-99418f57-f01d-4858-92b0-db68feae57c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:36.105801 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69723c28-11ff-42a8-b257-8269e3d63cb0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:36.179325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 507/1007] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:36.202593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:36.202778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99418f57-f01d-4858-92b0-db68feae57c8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:36.222366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69723c28-11ff-42a8-b257-8269e3d63cb0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:36.259799 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3dc33-eab9-406b-af95-311a138f3584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:36.260577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3dc33-eab9-406b-af95-311a138f3584 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:36.260856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3dc33-eab9-406b-af95-311a138f3584 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:36.261127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3dc33-eab9-406b-af95-311a138f3584 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:36.261814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3dc33-eab9-406b-af95-311a138f3584 None admin] RBAC: Adding query filter params (name=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:36.262118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3dc33-eab9-406b-af95-311a138f3584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:36.263602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3dc33-eab9-406b-af95-311a138f3584 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:36.268796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 501/1008] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:36.274177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3dc33-eab9-406b-af95-311a138f3584 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:36.308168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99418f57-f01d-4858-92b0-db68feae57c8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:36.331747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:36.344693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5651-d14c-45df-8bbe-7217f89e5d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:36.345445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5651-d14c-45df-8bbe-7217f89e5d93 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:36.345752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5651-d14c-45df-8bbe-7217f89e5d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:36.346024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5651-d14c-45df-8bbe-7217f89e5d93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:36.347462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5651-d14c-45df-8bbe-7217f89e5d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:36.348905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5651-d14c-45df-8bbe-7217f89e5d93 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:36.350515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 508/1009] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:36.356289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5651-d14c-45df-8bbe-7217f89e5d93 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:36.391175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3dc33-eab9-406b-af95-311a138f3584 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:36.431037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005222e-3e1e-445c-bdf4-1de3cfc69d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:36.431871 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005222e-3e1e-445c-bdf4-1de3cfc69d7a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:36.432295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005222e-3e1e-445c-bdf4-1de3cfc69d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:36.432708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005222e-3e1e-445c-bdf4-1de3cfc69d7a None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:36.433528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005222e-3e1e-445c-bdf4-1de3cfc69d7a None admin] RBAC: Adding query filter params (type=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:36.433987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005222e-3e1e-445c-bdf4-1de3cfc69d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:36.436083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005222e-3e1e-445c-bdf4-1de3cfc69d7a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:36.441034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 502/1010] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:36.481674 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5651-d14c-45df-8bbe-7217f89e5d93 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:36.521377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48b6e7-6837-400a-aeb2-783807d818d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:36.522010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48b6e7-6837-400a-aeb2-783807d818d0 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:36.522292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48b6e7-6837-400a-aeb2-783807d818d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:36.522566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48b6e7-6837-400a-aeb2-783807d818d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:36.523309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48b6e7-6837-400a-aeb2-783807d818d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:36.524800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48b6e7-6837-400a-aeb2-783807d818d0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:36.555157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 509/1011] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:37:36 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:37:36.741401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc0f0-4379-4233-9a92-59d29814a910 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:36.741585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc0f0-4379-4233-9a92-59d29814a910 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:36.741855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc0f0-4379-4233-9a92-59d29814a910 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:36.743526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 503/1012] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:36.748793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65a61-7c10-4531-ba94-1651d7bf3270 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:36.749160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65a61-7c10-4531-ba94-1651d7bf3270 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:36.749449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65a61-7c10-4531-ba94-1651d7bf3270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:36.768998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-def65a61-7c10-4531-ba94-1651d7bf3270 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:36.770184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-def65a61-7c10-4531-ba94-1651d7bf3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:36.807928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:36.855004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 510/1013] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:36.875051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc0f0-4379-4233-9a92-59d29814a910 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:36.893795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:36.984482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc0f0-4379-4233-9a92-59d29814a910 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:37.019549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee8833-3779-4ab9-a326-fdc48679ee4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:37.020109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee8833-3779-4ab9-a326-fdc48679ee4e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:37.020381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee8833-3779-4ab9-a326-fdc48679ee4e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:37.020645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee8833-3779-4ab9-a326-fdc48679ee4e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:37.021266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee8833-3779-4ab9-a326-fdc48679ee4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:37.022615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee8833-3779-4ab9-a326-fdc48679ee4e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5bee8833-3779-4ab9-a326-fdc48679ee4e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:37.031607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:37.032655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 07:37:37.033597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:37.035009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 504/1014] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:37.038968 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def65a61-7c10-4531-ba94-1651d7bf3270 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:37.147527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def65a61-7c10-4531-ba94-1651d7bf3270 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:37.188962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72946d0-f59b-44fd-a837-0793ec364bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:37.189597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72946d0-f59b-44fd-a837-0793ec364bdb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:37.189879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72946d0-f59b-44fd-a837-0793ec364bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:37.190155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72946d0-f59b-44fd-a837-0793ec364bdb None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:37.192530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72946d0-f59b-44fd-a837-0793ec364bdb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:37.192530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72946d0-f59b-44fd-a837-0793ec364bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:37.192807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72946d0-f59b-44fd-a837-0793ec364bdb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:37.203341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 511/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:37.204922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee8833-3779-4ab9-a326-fdc48679ee4e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:37.286713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:37.310625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee8833-3779-4ab9-a326-fdc48679ee4e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:37.343622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fceb15-3c01-4a3d-ab77-9b4fedb108eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:37.344237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fceb15-3c01-4a3d-ab77-9b4fedb108eb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:37.344547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fceb15-3c01-4a3d-ab77-9b4fedb108eb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:37.344772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fceb15-3c01-4a3d-ab77-9b4fedb108eb None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:37.345450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fceb15-3c01-4a3d-ab77-9b4fedb108eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:37.345798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fceb15-3c01-4a3d-ab77-9b4fedb108eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:37.347400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fceb15-3c01-4a3d-ab77-9b4fedb108eb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:37.357478 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 505/1016] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 27 07:37:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:37.359209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72946d0-f59b-44fd-a837-0793ec364bdb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:37.394373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:37.470495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72946d0-f59b-44fd-a837-0793ec364bdb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:37.503803 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7b83a-f878-4ea6-bf3e-165d0a7ae9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:37.504415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7b83a-f878-4ea6-bf3e-165d0a7ae9eb None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:37.504693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7b83a-f878-4ea6-bf3e-165d0a7ae9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:37.504960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7b83a-f878-4ea6-bf3e-165d0a7ae9eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:37.505658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7b83a-f878-4ea6-bf3e-165d0a7ae9eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:37.507049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7b83a-f878-4ea6-bf3e-165d0a7ae9eb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:37.539001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 512/1017] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:37:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:37:38.502640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebbf40-b650-4f89-920a-9c32353fbb73 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:38.503190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebbf40-b650-4f89-920a-9c32353fbb73 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:38.503293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebbf40-b650-4f89-920a-9c32353fbb73 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:38.504716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 506/1018] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:38.509654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c643be-0e31-4c24-991a-32eab981bc9e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:38.510089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c643be-0e31-4c24-991a-32eab981bc9e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:38.510417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c643be-0e31-4c24-991a-32eab981bc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:38.528846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f7c643be-0e31-4c24-991a-32eab981bc9e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:38.530040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f7c643be-0e31-4c24-991a-32eab981bc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:38.603650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 513/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:38 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:38.626309 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebbf40-b650-4f89-920a-9c32353fbb73 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:38.709812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d51be-819b-40e2-8962-8d1affb990a7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:38.709991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d51be-819b-40e2-8962-8d1affb990a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:38.710270 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d51be-819b-40e2-8962-8d1affb990a7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:38.711686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 514/1020] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:38.718471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368b964-9563-4f76-a8c7-01ad8137c3bb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:38.718760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368b964-9563-4f76-a8c7-01ad8137c3bb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:38.719376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368b964-9563-4f76-a8c7-01ad8137c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:38.740697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6368b964-9563-4f76-a8c7-01ad8137c3bb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:38.741894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6368b964-9563-4f76-a8c7-01ad8137c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:38.744073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebbf40-b650-4f89-920a-9c32353fbb73 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:38.756627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:38.785155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f7366-bfb5-4723-a402-0e483c872dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:38.785816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f7366-bfb5-4723-a402-0e483c872dd8 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:38.786099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f7366-bfb5-4723-a402-0e483c872dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:38.786371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f7366-bfb5-4723-a402-0e483c872dd8 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:38.787125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f7366-bfb5-4723-a402-0e483c872dd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:38.788490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f7366-bfb5-4723-a402-0e483c872dd8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:38.800150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:38.806961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 507/1021] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:37:38 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:38.829352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 515/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:38.857130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f7366-bfb5-4723-a402-0e483c872dd8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:38.975650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f7366-bfb5-4723-a402-0e483c872dd8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:39.009854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b9dad-8e2e-4645-a9f8-90fb55f13cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:39.010504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9dad-8e2e-4645-a9f8-90fb55f13cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:39.010777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9dad-8e2e-4645-a9f8-90fb55f13cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:39.011073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9dad-8e2e-4645-a9f8-90fb55f13cf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:39.012220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b9dad-8e2e-4645-a9f8-90fb55f13cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:39.014184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b9dad-8e2e-4645-a9f8-90fb55f13cf3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:39.016054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 508/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:39.021669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368b964-9563-4f76-a8c7-01ad8137c3bb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:39.123638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368b964-9563-4f76-a8c7-01ad8137c3bb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:39.159188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16cde3-3456-43bf-a9a1-b24dd44c49ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:39.159809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16cde3-3456-43bf-a9a1-b24dd44c49ca None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:39.160081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16cde3-3456-43bf-a9a1-b24dd44c49ca None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:39.160351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16cde3-3456-43bf-a9a1-b24dd44c49ca None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:39.161045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16cde3-3456-43bf-a9a1-b24dd44c49ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:39.162472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16cde3-3456-43bf-a9a1-b24dd44c49ca None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:39.181090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:39.189868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 516/1024] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:37:39 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:39.674045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51605bc-0636-498f-a75c-809f810eec69 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:39.674604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51605bc-0636-498f-a75c-809f810eec69 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:39.674604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51605bc-0636-498f-a75c-809f810eec69 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:39.676207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 509/1025] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:39.681414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bf778-e8ab-4fd4-b146-07ef907ac911 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:39.681815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bf778-e8ab-4fd4-b146-07ef907ac911 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:39.681911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bf778-e8ab-4fd4-b146-07ef907ac911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:39.700508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0f2bf778-e8ab-4fd4-b146-07ef907ac911 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:39.701792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0f2bf778-e8ab-4fd4-b146-07ef907ac911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:39.770312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 517/1026] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:39.792599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51605bc-0636-498f-a75c-809f810eec69 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:39.866857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:39.908768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51605bc-0636-498f-a75c-809f810eec69 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:39.944532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba13a32-34d9-45a1-af8a-4f6f3a69c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:39.945070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13a32-34d9-45a1-af8a-4f6f3a69c4bd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:39.945354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13a32-34d9-45a1-af8a-4f6f3a69c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:39.945626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13a32-34d9-45a1-af8a-4f6f3a69c4bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:39.958811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba13a32-34d9-45a1-af8a-4f6f3a69c4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-4ba13a32-34d9-45a1-af8a-4f6f3a69c4bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:39.963828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:39.964762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:39.965592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 510/1027] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 27 07:37:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:39.972052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bf778-e8ab-4fd4-b146-07ef907ac911 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:40.072142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bf778-e8ab-4fd4-b146-07ef907ac911 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:40.101937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:40.109192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655a875-3fb4-4f04-93ab-44dc7f7617bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:40.109817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a875-3fb4-4f04-93ab-44dc7f7617bb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:40.110096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a875-3fb4-4f04-93ab-44dc7f7617bb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:40.110369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a875-3fb4-4f04-93ab-44dc7f7617bb None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:40.111120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655a875-3fb4-4f04-93ab-44dc7f7617bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:40.111430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655a875-3fb4-4f04-93ab-44dc7f7617bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:40.112804 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655a875-3fb4-4f04-93ab-44dc7f7617bb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:40.125748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 518/1028] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 27 07:37:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:40.127102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba13a32-34d9-45a1-af8a-4f6f3a69c4bd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:40.229033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba13a32-34d9-45a1-af8a-4f6f3a69c4bd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:40.262972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:40.275261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ddd55-7fa5-4a18-85e1-0e842b688bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:40.276204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ddd55-7fa5-4a18-85e1-0e842b688bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:40.276622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ddd55-7fa5-4a18-85e1-0e842b688bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:40.277029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ddd55-7fa5-4a18-85e1-0e842b688bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:40.288138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ddd55-7fa5-4a18-85e1-0e842b688bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:40.289595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ddd55-7fa5-4a18-85e1-0e842b688bb3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-301ddd55-7fa5-4a18-85e1-0e842b688bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:40.304451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:40.305471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:40.311647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:40.311647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:40.311647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:40.311647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:40.311647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 511/1029] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:40.313003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655a875-3fb4-4f04-93ab-44dc7f7617bb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:40.419902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655a875-3fb4-4f04-93ab-44dc7f7617bb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:40.457644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c0af9-ba01-49ec-88d0-f322549a4491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:40.458259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c0af9-ba01-49ec-88d0-f322549a4491 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:40.458540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c0af9-ba01-49ec-88d0-f322549a4491 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:40.458815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c0af9-ba01-49ec-88d0-f322549a4491 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:40.459543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c0af9-ba01-49ec-88d0-f322549a4491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:40.459849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c0af9-ba01-49ec-88d0-f322549a4491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:40.461229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c0af9-ba01-49ec-88d0-f322549a4491 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:40.478274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 519/1030] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:40.479509 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ddd55-7fa5-4a18-85e1-0e842b688bb3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:40.583743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ddd55-7fa5-4a18-85e1-0e842b688bb3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:40.619414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af378893-f82c-40c3-8da1-2de3d01cb363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:40.620066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af378893-f82c-40c3-8da1-2de3d01cb363 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:40.620348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af378893-f82c-40c3-8da1-2de3d01cb363 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:40.620621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af378893-f82c-40c3-8da1-2de3d01cb363 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:40.629178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af378893-f82c-40c3-8da1-2de3d01cb363 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:40.630651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af378893-f82c-40c3-8da1-2de3d01cb363 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-af378893-f82c-40c3-8da1-2de3d01cb363 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:40.642121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:40.643113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:40.648688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 512/1031] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 27 07:37:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:40.649294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c0af9-ba01-49ec-88d0-f322549a4491 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:40.703521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:40.753212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c0af9-ba01-49ec-88d0-f322549a4491 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:40.787655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0d694-822e-4da8-810c-a00bbb808def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:40.788279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0d694-822e-4da8-810c-a00bbb808def None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:40.788557 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0d694-822e-4da8-810c-a00bbb808def None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:40.788830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0d694-822e-4da8-810c-a00bbb808def None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:40.789631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0d694-822e-4da8-810c-a00bbb808def None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:40.789936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0d694-822e-4da8-810c-a00bbb808def None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:40.791396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0d694-822e-4da8-810c-a00bbb808def None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:40.814178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 520/1032] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 27 07:37:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:40.815456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af378893-f82c-40c3-8da1-2de3d01cb363 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:40.860136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:40.885205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3edc44-02e9-4672-9c18-a74603f9e43b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:40.885533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3edc44-02e9-4672-9c18-a74603f9e43b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:40.885810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3edc44-02e9-4672-9c18-a74603f9e43b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:40.887580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 521/1033] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:40.893141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ce0ef-b808-4bff-acf4-b0942f9daae6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:40.893428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ce0ef-b808-4bff-acf4-b0942f9daae6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:40.893680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ce0ef-b808-4bff-acf4-b0942f9daae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:40.912330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c22ce0ef-b808-4bff-acf4-b0942f9daae6 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:40.913506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c22ce0ef-b808-4bff-acf4-b0942f9daae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:40.923566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af378893-f82c-40c3-8da1-2de3d01cb363 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:40.965841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065b91-926a-4cdc-959c-2bf1f36a40e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:40.967323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065b91-926a-4cdc-959c-2bf1f36a40e9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:40.967607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065b91-926a-4cdc-959c-2bf1f36a40e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:40.967883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065b91-926a-4cdc-959c-2bf1f36a40e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:40.984416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 522/1034] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:41.006418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ce0ef-b808-4bff-acf4-b0942f9daae6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.043655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26065b91-926a-4cdc-959c-2bf1f36a40e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.045150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26065b91-926a-4cdc-959c-2bf1f36a40e9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.049118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:41.087945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:41.113758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ce0ef-b808-4bff-acf4-b0942f9daae6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.152845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950922e-3290-4e23-866f-55097b745e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.157838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950922e-3290-4e23-866f-55097b745e8b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.157964 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 513/1035] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 07:37:41.158067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950922e-3290-4e23-866f-55097b745e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.158067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950922e-3290-4e23-866f-55097b745e8b None admin] PATH_INFO: `/v3/services/image` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.158067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950922e-3290-4e23-866f-55097b745e8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.158067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950922e-3290-4e23-866f-55097b745e8b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.159099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065b91-926a-4cdc-959c-2bf1f36a40e9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1950922e-3290-4e23-866f-55097b745e8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:41.166020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:41.167141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:41.168065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 523/1036] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:41.173731 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950922e-3290-4e23-866f-55097b745e8b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.267848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065b91-926a-4cdc-959c-2bf1f36a40e9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.284293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950922e-3290-4e23-866f-55097b745e8b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.287437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:41.302460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945ee49-c018-4627-a11a-84dbe18b9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.303140 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945ee49-c018-4627-a11a-84dbe18b9c0b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.303421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945ee49-c018-4627-a11a-84dbe18b9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.303692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945ee49-c018-4627-a11a-84dbe18b9c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.311958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:41.314317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945ee49-c018-4627-a11a-84dbe18b9c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.316091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945ee49-c018-4627-a11a-84dbe18b9c0b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.321239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911d16c-8d57-42de-99dc-c6abbc85260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.321849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d16c-8d57-42de-99dc-c6abbc85260d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.322128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d16c-8d57-42de-99dc-c6abbc85260d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.322397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d16c-8d57-42de-99dc-c6abbc85260d None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.323113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911d16c-8d57-42de-99dc-c6abbc85260d None admin] RBAC: Adding query filter params (name=image) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:41.323412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911d16c-8d57-42de-99dc-c6abbc85260d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.324772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911d16c-8d57-42de-99dc-c6abbc85260d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.330083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 524/1037] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:41.331281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8bee-8e8a-4951-aa77-12c5d36cdf5c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.331562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8bee-8e8a-4951-aa77-12c5d36cdf5c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.331834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8bee-8e8a-4951-aa77-12c5d36cdf5c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0945ee49-c018-4627-a11a-84dbe18b9c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:41.332056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:41.332900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:41.333798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:41.333798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:41.333798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:41.333798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:41.334020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 525/1038] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:41.334920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 514/1039] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:41.338389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8bee-8e8a-4951-aa77-12c5d36cdf5c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.338830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945ee49-c018-4627-a11a-84dbe18b9c0b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.439401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945ee49-c018-4627-a11a-84dbe18b9c0b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.448661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8bee-8e8a-4951-aa77-12c5d36cdf5c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.473870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c470db-a162-438a-b7a3-a811d8b8201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.474483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c470db-a162-438a-b7a3-a811d8b8201d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.474763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c470db-a162-438a-b7a3-a811d8b8201d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.475065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c470db-a162-438a-b7a3-a811d8b8201d None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.475758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c470db-a162-438a-b7a3-a811d8b8201d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:41.476048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c470db-a162-438a-b7a3-a811d8b8201d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.477400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c470db-a162-438a-b7a3-a811d8b8201d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.484979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a143ed8-a0af-4d57-ba01-5c75ece363cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.485595 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a143ed8-a0af-4d57-ba01-5c75ece363cc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.486315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a143ed8-a0af-4d57-ba01-5c75ece363cc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.486601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a143ed8-a0af-4d57-ba01-5c75ece363cc None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.487322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a143ed8-a0af-4d57-ba01-5c75ece363cc None admin] RBAC: Adding query filter params (type=image) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:41.487630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a143ed8-a0af-4d57-ba01-5c75ece363cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.488937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 515/1040] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:41.489031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a143ed8-a0af-4d57-ba01-5c75ece363cc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.490290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe06602-c7c3-4745-8742-404ed1e97558 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.490570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe06602-c7c3-4745-8742-404ed1e97558 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.491120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe06602-c7c3-4745-8742-404ed1e97558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.494191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 526/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:41.495035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a143ed8-a0af-4d57-ba01-5c75ece363cc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.510681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bbe06602-c7c3-4745-8742-404ed1e97558 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:41.511898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bbe06602-c7c3-4745-8742-404ed1e97558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:41.525853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:41.559473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:41.580038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 516/1042] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:41.581088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe06602-c7c3-4745-8742-404ed1e97558 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.604708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a143ed8-a0af-4d57-ba01-5c75ece363cc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.640825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546272c-f3c5-49d4-862c-5e6df20ed74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.641470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546272c-f3c5-49d4-862c-5e6df20ed74c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.641746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546272c-f3c5-49d4-862c-5e6df20ed74c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.642018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546272c-f3c5-49d4-862c-5e6df20ed74c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.648827 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546272c-f3c5-49d4-862c-5e6df20ed74c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.650288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546272c-f3c5-49d4-862c-5e6df20ed74c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3546272c-f3c5-49d4-862c-5e6df20ed74c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:41.661430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:41.662509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 527/1043] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:41.663487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546272c-f3c5-49d4-862c-5e6df20ed74c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.690368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe06602-c7c3-4745-8742-404ed1e97558 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.725742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80497f0b-ac4b-46fa-8e62-bcb22eacff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.726290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80497f0b-ac4b-46fa-8e62-bcb22eacff3c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.726658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80497f0b-ac4b-46fa-8e62-bcb22eacff3c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.726970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80497f0b-ac4b-46fa-8e62-bcb22eacff3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.727625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80497f0b-ac4b-46fa-8e62-bcb22eacff3c None admin] RBAC: Adding query filter params (interface=public, service_id=e01f2134f83944c38ae7151facc63d82, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:41.727933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80497f0b-ac4b-46fa-8e62-bcb22eacff3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.729295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80497f0b-ac4b-46fa-8e62-bcb22eacff3c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.734495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 517/1044] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/endpoints?service_id=e01f2134f83944c38ae7151facc63d82&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:41.735330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80497f0b-ac4b-46fa-8e62-bcb22eacff3c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.757005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:41.768067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546272c-f3c5-49d4-862c-5e6df20ed74c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.782683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:41.802220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18505f7-c4c4-4538-9b13-193c503a5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.802865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18505f7-c4c4-4538-9b13-193c503a5a15 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.803173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18505f7-c4c4-4538-9b13-193c503a5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.803449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18505f7-c4c4-4538-9b13-193c503a5a15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.814460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18505f7-c4c4-4538-9b13-193c503a5a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e18505f7-c4c4-4538-9b13-193c503a5a15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:41.819369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:41.820350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:41.821198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 528/1045] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:41.821915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18505f7-c4c4-4538-9b13-193c503a5a15 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.839408 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80497f0b-ac4b-46fa-8e62-bcb22eacff3c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.875130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797cd0-6003-41d0-8cd0-4b040c1eede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.876010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797cd0-6003-41d0-8cd0-4b040c1eede8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.876287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797cd0-6003-41d0-8cd0-4b040c1eede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.876556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797cd0-6003-41d0-8cd0-4b040c1eede8 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.877305 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797cd0-6003-41d0-8cd0-4b040c1eede8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:41.877605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797cd0-6003-41d0-8cd0-4b040c1eede8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.879059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797cd0-6003-41d0-8cd0-4b040c1eede8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.893389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 518/1046] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:41.894261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797cd0-6003-41d0-8cd0-4b040c1eede8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:41.942021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18505f7-c4c4-4538-9b13-193c503a5a15 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:41.976853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd555c59-d78b-40f6-8c76-bd5f75d054f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:41.977461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd555c59-d78b-40f6-8c76-bd5f75d054f5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:41.977734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd555c59-d78b-40f6-8c76-bd5f75d054f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:41.978002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd555c59-d78b-40f6-8c76-bd5f75d054f5 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:41.978651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd555c59-d78b-40f6-8c76-bd5f75d054f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:41.980060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd555c59-d78b-40f6-8c76-bd5f75d054f5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:41.986533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 529/1047] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:37:41.987341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd555c59-d78b-40f6-8c76-bd5f75d054f5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:42.000418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797cd0-6003-41d0-8cd0-4b040c1eede8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:42.009188 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:42.010907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:42.041069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf425a-1cfb-4aca-aa60-0685ec860641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:42.041779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf425a-1cfb-4aca-aa60-0685ec860641 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:42.042132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf425a-1cfb-4aca-aa60-0685ec860641 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:42.042410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf425a-1cfb-4aca-aa60-0685ec860641 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:42.043194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf425a-1cfb-4aca-aa60-0685ec860641 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:42.043507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf425a-1cfb-4aca-aa60-0685ec860641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:42.045032 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf425a-1cfb-4aca-aa60-0685ec860641 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:42.055509 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 519/1048] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:42.061356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf425a-1cfb-4aca-aa60-0685ec860641 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:42.113160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd555c59-d78b-40f6-8c76-bd5f75d054f5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:42.152574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73286e9-3085-4a44-8cad-313eee56b196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:42.154292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73286e9-3085-4a44-8cad-313eee56b196 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:42.154573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73286e9-3085-4a44-8cad-313eee56b196 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:42.154846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73286e9-3085-4a44-8cad-313eee56b196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:42.155729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73286e9-3085-4a44-8cad-313eee56b196 None admin] RBAC: Adding query filter params (role.id=62e0df5fca9d4e5189763857170ae97f, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=0445b52b85994510ad9e66de366ebf4d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:42.156037 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73286e9-3085-4a44-8cad-313eee56b196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:42.157498 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73286e9-3085-4a44-8cad-313eee56b196 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:42.163201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 530/1049] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:41 2022] GET /identity/v3/role_assignments?user.id=0445b52b85994510ad9e66de366ebf4d&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=62e0df5fca9d4e5189763857170ae97f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:42.180404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf425a-1cfb-4aca-aa60-0685ec860641 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:42.221073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146c3c3-6e48-4c25-b41f-e0f00f967cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:42.222003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c3c3-6e48-4c25-b41f-e0f00f967cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:42.222279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c3c3-6e48-4c25-b41f-e0f00f967cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:42.222549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c3c3-6e48-4c25-b41f-e0f00f967cb0 None admin] PATH_INFO: `/v3/users/4afcefff5e7c4cdc8882b057919502eb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:42.238202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146c3c3-6e48-4c25-b41f-e0f00f967cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=4afcefff5e7c4cdc8882b057919502eb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:42.239717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146c3c3-6e48-4c25-b41f-e0f00f967cb0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:42.241657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 520/1050] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:37:42 2022] GET /identity/v3/users/4afcefff5e7c4cdc8882b057919502eb => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:42.248023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73286e9-3085-4a44-8cad-313eee56b196 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:42.340402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:42.361550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73286e9-3085-4a44-8cad-313eee56b196 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:42.396303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a3f5e-195e-4235-8668-c3b22b5f5c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:42.396916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a3f5e-195e-4235-8668-c3b22b5f5c69 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:42.397193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a3f5e-195e-4235-8668-c3b22b5f5c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:42.397462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a3f5e-195e-4235-8668-c3b22b5f5c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:42.476844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a3f5e-195e-4235-8668-c3b22b5f5c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:42.478327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a3f5e-195e-4235-8668-c3b22b5f5c69 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:42.558080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:42.580144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 531/1051] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:42 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:37:42.585682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146c3c3-6e48-4c25-b41f-e0f00f967cb0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:42.616797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:42.693175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146c3c3-6e48-4c25-b41f-e0f00f967cb0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:42.727630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc5927-11a3-40d4-bb28-978db41e247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:42.728277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc5927-11a3-40d4-bb28-978db41e247d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:42.728552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc5927-11a3-40d4-bb28-978db41e247d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:42.728818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc5927-11a3-40d4-bb28-978db41e247d None admin] PATH_INFO: `/v3/projects/c5731a355f244c49bb60e1349876a983` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:42.729973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc5927-11a3-40d4-bb28-978db41e247d None admin] RBAC: Authorizing `identity:get_project(project_id=c5731a355f244c49bb60e1349876a983)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:42.731437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc5927-11a3-40d4-bb28-978db41e247d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:42.733768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 521/1052] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:37:42 2022] GET /identity/v3/projects/c5731a355f244c49bb60e1349876a983 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:42.739738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a3f5e-195e-4235-8668-c3b22b5f5c69 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:42.842373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a3f5e-195e-4235-8668-c3b22b5f5c69 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:42.878831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c1906-0d73-4162-900f-f79cd8cd7caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:42.879384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c1906-0d73-4162-900f-f79cd8cd7caf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:42.879657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c1906-0d73-4162-900f-f79cd8cd7caf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:42.879925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c1906-0d73-4162-900f-f79cd8cd7caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:42.880700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c1906-0d73-4162-900f-f79cd8cd7caf None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=c5731a355f244c49bb60e1349876a983, user.id=4afcefff5e7c4cdc8882b057919502eb) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:42.881007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c1906-0d73-4162-900f-f79cd8cd7caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:42.882423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c1906-0d73-4162-900f-f79cd8cd7caf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:42.894668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 532/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:42 2022] GET /identity/v3/role_assignments?user.id=4afcefff5e7c4cdc8882b057919502eb&scope.project.id=c5731a355f244c49bb60e1349876a983&role.id=2ba3b2926541436a9d26782420538af3 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:44.020083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd3bde-e6e2-4d13-bf8c-994e3be29caf None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.020614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd3bde-e6e2-4d13-bf8c-994e3be29caf None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.020614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd3bde-e6e2-4d13-bf8c-994e3be29caf None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.021996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 522/1054] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:44.028119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f5d0-e7ed-4b64-bd48-15a104620805 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.029050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f5d0-e7ed-4b64-bd48-15a104620805 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.029272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f5d0-e7ed-4b64-bd48-15a104620805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.048328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0882f5d0-e7ed-4b64-bd48-15a104620805 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:44.049529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0882f5d0-e7ed-4b64-bd48-15a104620805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:44.092966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:44.121394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 533/1055] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:44.143886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd3bde-e6e2-4d13-bf8c-994e3be29caf None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:44.207138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4336b-d997-4d84-b327-94b64fae5ec2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.207778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4336b-d997-4d84-b327-94b64fae5ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.208294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4336b-d997-4d84-b327-94b64fae5ec2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.210005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 534/1056] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:44.216116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce027c-2589-4a54-a5da-b0bc00b3b6ef None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.216510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce027c-2589-4a54-a5da-b0bc00b3b6ef None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.217003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce027c-2589-4a54-a5da-b0bc00b3b6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.235363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2bce027c-2589-4a54-a5da-b0bc00b3b6ef None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:44.236537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2bce027c-2589-4a54-a5da-b0bc00b3b6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:44.245573 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:44.255702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd3bde-e6e2-4d13-bf8c-994e3be29caf None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:44.290717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1b3e3-136a-4508-8083-138c29e72055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:44.291356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1b3e3-136a-4508-8083-138c29e72055 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.291685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1b3e3-136a-4508-8083-138c29e72055 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.291904 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1b3e3-136a-4508-8083-138c29e72055 None admin] PATH_INFO: `/v3/services/image` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.292539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1b3e3-136a-4508-8083-138c29e72055 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:44.293906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1b3e3-136a-4508-8083-138c29e72055 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-68b1b3e3-136a-4508-8083-138c29e72055 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:44.304246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:44.305287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:44.306119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 523/1057] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jul 27 07:37:44 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:44.311263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1b3e3-136a-4508-8083-138c29e72055 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:44.315215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 535/1058] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:44.332426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce027c-2589-4a54-a5da-b0bc00b3b6ef None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:44.430630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1b3e3-136a-4508-8083-138c29e72055 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:44.453170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce027c-2589-4a54-a5da-b0bc00b3b6ef None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:44.456121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:44.482274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b7596-c629-4445-8b9e-d8803b266693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:44.483093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7596-c629-4445-8b9e-d8803b266693 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.483378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7596-c629-4445-8b9e-d8803b266693 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.483653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7596-c629-4445-8b9e-d8803b266693 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.484350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b7596-c629-4445-8b9e-d8803b266693 None admin] RBAC: Adding query filter params (name=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:44.484656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b7596-c629-4445-8b9e-d8803b266693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:44.486031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b7596-c629-4445-8b9e-d8803b266693 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:44.491891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 524/1059] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:44.496567 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a85ad-7b6d-4dbb-86d5-c4a648b8c970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:44.497058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a85ad-7b6d-4dbb-86d5-c4a648b8c970 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.497862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a85ad-7b6d-4dbb-86d5-c4a648b8c970 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.498134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a85ad-7b6d-4dbb-86d5-c4a648b8c970 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.499491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b7596-c629-4445-8b9e-d8803b266693 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:44.512528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a85ad-7b6d-4dbb-86d5-c4a648b8c970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1e3a85ad-7b6d-4dbb-86d5-c4a648b8c970 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:44.518110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:44.519099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:44.519934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 536/1060] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 27 07:37:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:44.525368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a85ad-7b6d-4dbb-86d5-c4a648b8c970 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:44.530984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:44.617154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b7596-c629-4445-8b9e-d8803b266693 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:44.632296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a85ad-7b6d-4dbb-86d5-c4a648b8c970 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:44.652939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c149bb-a0b3-4b54-8d1f-313d4d7ea18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:44.654327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c149bb-a0b3-4b54-8d1f-313d4d7ea18c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.654327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c149bb-a0b3-4b54-8d1f-313d4d7ea18c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.654608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c149bb-a0b3-4b54-8d1f-313d4d7ea18c None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.655293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c149bb-a0b3-4b54-8d1f-313d4d7ea18c None admin] RBAC: Adding query filter params (type=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:44.655601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c149bb-a0b3-4b54-8d1f-313d4d7ea18c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:44.656968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c149bb-a0b3-4b54-8d1f-313d4d7ea18c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:44.666712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 525/1061] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:44.667724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c149bb-a0b3-4b54-8d1f-313d4d7ea18c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:44.674857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d778be-94b5-458b-b2e6-5de56131d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:44.675496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d778be-94b5-458b-b2e6-5de56131d12a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.675777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d778be-94b5-458b-b2e6-5de56131d12a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.676043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d778be-94b5-458b-b2e6-5de56131d12a None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.676759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d778be-94b5-458b-b2e6-5de56131d12a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:44.677057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d778be-94b5-458b-b2e6-5de56131d12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:44.678567 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d778be-94b5-458b-b2e6-5de56131d12a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:44.686776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 537/1062] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 27 07:37:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:44.692239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d778be-94b5-458b-b2e6-5de56131d12a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:44.724281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:44.766783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:44.783048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c149bb-a0b3-4b54-8d1f-313d4d7ea18c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:44.805948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d778be-94b5-458b-b2e6-5de56131d12a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:44.818328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781bc2-2650-48db-985c-760ccf87d303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:44.819289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781bc2-2650-48db-985c-760ccf87d303 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.819578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781bc2-2650-48db-985c-760ccf87d303 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.820016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781bc2-2650-48db-985c-760ccf87d303 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.820739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781bc2-2650-48db-985c-760ccf87d303 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:44.822109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781bc2-2650-48db-985c-760ccf87d303 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:44.845560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 526/1063] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:37:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:44.855024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688ff5e-6066-4259-a78d-6d9539732d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:44.855691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ff5e-6066-4259-a78d-6d9539732d56 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.855970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ff5e-6066-4259-a78d-6d9539732d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.856237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688ff5e-6066-4259-a78d-6d9539732d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.869068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688ff5e-6066-4259-a78d-6d9539732d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:44.870508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688ff5e-6066-4259-a78d-6d9539732d56 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6688ff5e-6066-4259-a78d-6d9539732d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:44.889985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:44.891261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:44.897051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:44.897051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:44.897051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:44.897051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:44.897051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 538/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:44.897373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781bc2-2650-48db-985c-760ccf87d303 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:44.909120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f4829-d3f1-49f5-a5cc-8cd692d3946f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.909456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f4829-d3f1-49f5-a5cc-8cd692d3946f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.909704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f4829-d3f1-49f5-a5cc-8cd692d3946f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.911117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 539/1065] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:44.916932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779ae36-43ee-45e0-8d5c-bb319a2928d9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:44.917213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779ae36-43ee-45e0-8d5c-bb319a2928d9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:44.917482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779ae36-43ee-45e0-8d5c-bb319a2928d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:44.937061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7779ae36-43ee-45e0-8d5c-bb319a2928d9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:44.938397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7779ae36-43ee-45e0-8d5c-bb319a2928d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:45.021108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781bc2-2650-48db-985c-760ccf87d303 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.022224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 540/1066] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:45.046012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779ae36-43ee-45e0-8d5c-bb319a2928d9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.049281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:45.064465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028482-be70-4632-b825-5ad1fc4651ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.065094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028482-be70-4632-b825-5ad1fc4651ed None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.065373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028482-be70-4632-b825-5ad1fc4651ed None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.065647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028482-be70-4632-b825-5ad1fc4651ed None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.066340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c028482-be70-4632-b825-5ad1fc4651ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:45.066641 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c028482-be70-4632-b825-5ad1fc4651ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:45.068072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c028482-be70-4632-b825-5ad1fc4651ed None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:45.080547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 527/1067] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:45.085927 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028482-be70-4632-b825-5ad1fc4651ed None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.088818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:45.161371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779ae36-43ee-45e0-8d5c-bb319a2928d9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.195416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028482-be70-4632-b825-5ad1fc4651ed None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.197152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018b29-75e8-4e69-b0f8-d7b759bddd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.197808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018b29-75e8-4e69-b0f8-d7b759bddd43 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.198088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018b29-75e8-4e69-b0f8-d7b759bddd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.198363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018b29-75e8-4e69-b0f8-d7b759bddd43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.210499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02018b29-75e8-4e69-b0f8-d7b759bddd43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-02018b29-75e8-4e69-b0f8-d7b759bddd43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:45.216778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:45.217727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:45.219851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 541/1068] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:45.224056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018b29-75e8-4e69-b0f8-d7b759bddd43 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.238208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09539ac9-85cc-4ba0-b57b-4afab0ac56ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.239235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09539ac9-85cc-4ba0-b57b-4afab0ac56ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.239668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09539ac9-85cc-4ba0-b57b-4afab0ac56ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.240205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09539ac9-85cc-4ba0-b57b-4afab0ac56ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.248843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09539ac9-85cc-4ba0-b57b-4afab0ac56ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:45.250505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09539ac9-85cc-4ba0-b57b-4afab0ac56ae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-09539ac9-85cc-4ba0-b57b-4afab0ac56ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:45.263239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:45.264216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:45.265155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 528/1069] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 27 07:37:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:45.270122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09539ac9-85cc-4ba0-b57b-4afab0ac56ae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.291657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:45.332820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:45.335735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018b29-75e8-4e69-b0f8-d7b759bddd43 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.373353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105ca93-db84-41ad-97df-dc9968f01d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.373970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105ca93-db84-41ad-97df-dc9968f01d26 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.374410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105ca93-db84-41ad-97df-dc9968f01d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.374606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105ca93-db84-41ad-97df-dc9968f01d26 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.375281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105ca93-db84-41ad-97df-dc9968f01d26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:45.375585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105ca93-db84-41ad-97df-dc9968f01d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:45.376981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105ca93-db84-41ad-97df-dc9968f01d26 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:45.386054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 542/1070] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:45.388658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09539ac9-85cc-4ba0-b57b-4afab0ac56ae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.392707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105ca93-db84-41ad-97df-dc9968f01d26 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.438342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978adccd-efbb-4afc-b128-5b1bdeada9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.439740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978adccd-efbb-4afc-b128-5b1bdeada9fa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.439740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978adccd-efbb-4afc-b128-5b1bdeada9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.439740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978adccd-efbb-4afc-b128-5b1bdeada9fa None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.440446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978adccd-efbb-4afc-b128-5b1bdeada9fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:45.440753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978adccd-efbb-4afc-b128-5b1bdeada9fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:45.442220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978adccd-efbb-4afc-b128-5b1bdeada9fa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:45.462729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 529/1071] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 27 07:37:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:45.468552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978adccd-efbb-4afc-b128-5b1bdeada9fa None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.505876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105ca93-db84-41ad-97df-dc9968f01d26 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.533211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:45.543439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25c39-d38a-45e6-b834-dbe98fa5a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.545001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25c39-d38a-45e6-b834-dbe98fa5a649 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.545589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25c39-d38a-45e6-b834-dbe98fa5a649 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.546072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25c39-d38a-45e6-b834-dbe98fa5a649 None admin] PATH_INFO: `/v3/users/4afcefff5e7c4cdc8882b057919502eb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.547716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a25c39-d38a-45e6-b834-dbe98fa5a649 None admin] RBAC: Authorizing `identity:get_user(user_id=4afcefff5e7c4cdc8882b057919502eb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:45.549369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a25c39-d38a-45e6-b834-dbe98fa5a649 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:45.551808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 543/1072] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:37:45 2022] GET /identity/v3/users/4afcefff5e7c4cdc8882b057919502eb => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:45.557149 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25c39-d38a-45e6-b834-dbe98fa5a649 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.580834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978adccd-efbb-4afc-b128-5b1bdeada9fa None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.604789 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:45.621707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c93e-c694-48fe-8cfc-7b5b5417dd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.622354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c93e-c694-48fe-8cfc-7b5b5417dd35 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.622642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c93e-c694-48fe-8cfc-7b5b5417dd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.622938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c93e-c694-48fe-8cfc-7b5b5417dd35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.634149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53c93e-c694-48fe-8cfc-7b5b5417dd35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:45.635685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53c93e-c694-48fe-8cfc-7b5b5417dd35 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-fd53c93e-c694-48fe-8cfc-7b5b5417dd35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:45.651459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:45.652453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:45.653998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:45.653998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:45.653998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:45.653998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:45.653998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 530/1073] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:45.658230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c93e-c694-48fe-8cfc-7b5b5417dd35 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.665255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25c39-d38a-45e6-b834-dbe98fa5a649 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.709483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248947fd-2b65-4efd-8c4e-3ecb8bbfea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.710034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248947fd-2b65-4efd-8c4e-3ecb8bbfea21 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.710326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248947fd-2b65-4efd-8c4e-3ecb8bbfea21 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.710600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248947fd-2b65-4efd-8c4e-3ecb8bbfea21 None admin] PATH_INFO: `/v3/projects/c5731a355f244c49bb60e1349876a983` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.711848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248947fd-2b65-4efd-8c4e-3ecb8bbfea21 None admin] RBAC: Authorizing `identity:get_project(project_id=c5731a355f244c49bb60e1349876a983)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:45.713393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248947fd-2b65-4efd-8c4e-3ecb8bbfea21 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:45.719942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 544/1074] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:37:45 2022] GET /identity/v3/projects/c5731a355f244c49bb60e1349876a983 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:45.721750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248947fd-2b65-4efd-8c4e-3ecb8bbfea21 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.771948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c93e-c694-48fe-8cfc-7b5b5417dd35 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.785393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:45.810190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443926e-86e9-4cd1-a1b9-5d251fe3e18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.811143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443926e-86e9-4cd1-a1b9-5d251fe3e18b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.811426 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443926e-86e9-4cd1-a1b9-5d251fe3e18b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.811698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443926e-86e9-4cd1-a1b9-5d251fe3e18b None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.812404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443926e-86e9-4cd1-a1b9-5d251fe3e18b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:45.812709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443926e-86e9-4cd1-a1b9-5d251fe3e18b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:45.814506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443926e-86e9-4cd1-a1b9-5d251fe3e18b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:45.825910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248947fd-2b65-4efd-8c4e-3ecb8bbfea21 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.827210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 531/1075] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:45.833946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443926e-86e9-4cd1-a1b9-5d251fe3e18b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:45.870130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d4b2e-a02e-4aff-97e9-be5fa297b3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.870798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4b2e-a02e-4aff-97e9-be5fa297b3f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.871113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4b2e-a02e-4aff-97e9-be5fa297b3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.871392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4b2e-a02e-4aff-97e9-be5fa297b3f0 None admin] PATH_INFO: `/v3/projects/c5731a355f244c49bb60e1349876a983/users/4afcefff5e7c4cdc8882b057919502eb/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:45.872441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:45.873472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d4b2e-a02e-4aff-97e9-be5fa297b3f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5731a355f244c49bb60e1349876a983, user_id=4afcefff5e7c4cdc8882b057919502eb, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:45.874917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d4b2e-a02e-4aff-97e9-be5fa297b3f0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:45.892308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 545/1076] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:37:45 2022] PUT /identity/v3/projects/c5731a355f244c49bb60e1349876a983/users/4afcefff5e7c4cdc8882b057919502eb/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:37:45.954344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443926e-86e9-4cd1-a1b9-5d251fe3e18b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:45.992918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cd8b1-e62c-4bea-a7fd-6acc314bf00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:45.993838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cd8b1-e62c-4bea-a7fd-6acc314bf00f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:45.994266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cd8b1-e62c-4bea-a7fd-6acc314bf00f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:45.994675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cd8b1-e62c-4bea-a7fd-6acc314bf00f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:46.003853 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cd8b1-e62c-4bea-a7fd-6acc314bf00f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:46.005668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cd8b1-e62c-4bea-a7fd-6acc314bf00f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9e1cd8b1-e62c-4bea-a7fd-6acc314bf00f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:46.019251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:46.020389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:46.021876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:46.021876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:46.021876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:46.021876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:46.021876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:46.021876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:46.021876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:46.021876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:46.023786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 532/1077] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:46.030194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d4b2e-a02e-4aff-97e9-be5fa297b3f0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:46.137307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d4b2e-a02e-4aff-97e9-be5fa297b3f0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:46.160575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:46.174732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303f8c2-2af7-4e9b-bc42-7925dd816595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:46.175381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303f8c2-2af7-4e9b-bc42-7925dd816595 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:46.175661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303f8c2-2af7-4e9b-bc42-7925dd816595 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:46.175931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303f8c2-2af7-4e9b-bc42-7925dd816595 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:46.176676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303f8c2-2af7-4e9b-bc42-7925dd816595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:46.176978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303f8c2-2af7-4e9b-bc42-7925dd816595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:46.178404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303f8c2-2af7-4e9b-bc42-7925dd816595 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:46.191006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 546/1078] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:46.196748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cd8b1-e62c-4bea-a7fd-6acc314bf00f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:46.290096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:46.300619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cd8b1-e62c-4bea-a7fd-6acc314bf00f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:46.334657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a1d78-38bd-427f-b297-bebb3f03052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:46.335356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a1d78-38bd-427f-b297-bebb3f03052f None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:46.335629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a1d78-38bd-427f-b297-bebb3f03052f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:46.335896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a1d78-38bd-427f-b297-bebb3f03052f None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/0445b52b85994510ad9e66de366ebf4d/roles/62e0df5fca9d4e5189763857170ae97f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:46.338043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a1d78-38bd-427f-b297-bebb3f03052f None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=0445b52b85994510ad9e66de366ebf4d, role_id=62e0df5fca9d4e5189763857170ae97f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:46.339503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a1d78-38bd-427f-b297-bebb3f03052f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:46.356113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 533/1079] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:37:46 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/0445b52b85994510ad9e66de366ebf4d/roles/62e0df5fca9d4e5189763857170ae97f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:37:46.925031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca73c6-55c9-486a-8b85-cc0ecd96484a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:46.925422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca73c6-55c9-486a-8b85-cc0ecd96484a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:46.925620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca73c6-55c9-486a-8b85-cc0ecd96484a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:46.927108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 547/1080] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:46.932074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595138f-33b5-4d26-b172-b9810bc16b01 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:46.932363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595138f-33b5-4d26-b172-b9810bc16b01 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:46.932643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595138f-33b5-4d26-b172-b9810bc16b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:46.951262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e595138f-33b5-4d26-b172-b9810bc16b01 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:46.952469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e595138f-33b5-4d26-b172-b9810bc16b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:47.024694 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 534/1081] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:47.047735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca73c6-55c9-486a-8b85-cc0ecd96484a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:47.153122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca73c6-55c9-486a-8b85-cc0ecd96484a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:47.187691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac4a2a-3b04-40d5-a71a-013f074b7aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:47.188236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac4a2a-3b04-40d5-a71a-013f074b7aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:47.188515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac4a2a-3b04-40d5-a71a-013f074b7aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:47.188787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac4a2a-3b04-40d5-a71a-013f074b7aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:47.238359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:47.258432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac4a2a-3b04-40d5-a71a-013f074b7aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:47.259939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac4a2a-3b04-40d5-a71a-013f074b7aa5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:47.364337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 548/1082] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:37:47.365896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595138f-33b5-4d26-b172-b9810bc16b01 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:47.456017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:47.479620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595138f-33b5-4d26-b172-b9810bc16b01 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:47.516632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484254a-431c-4c11-86a4-ea30bf555589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:47.517287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484254a-431c-4c11-86a4-ea30bf555589 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:47.517567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484254a-431c-4c11-86a4-ea30bf555589 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:47.517840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484254a-431c-4c11-86a4-ea30bf555589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:47.528149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484254a-431c-4c11-86a4-ea30bf555589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:47.529639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484254a-431c-4c11-86a4-ea30bf555589 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f484254a-431c-4c11-86a4-ea30bf555589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:47.544507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:47.545434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:47.551389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:47.551389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:47.551389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:47.551389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:47.551389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 535/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:47.552063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac4a2a-3b04-40d5-a71a-013f074b7aa5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:47.636607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:47.656154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac4a2a-3b04-40d5-a71a-013f074b7aa5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:47.689745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e546-ab2c-4d62-b168-27fb469bfe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:47.690362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e546-ab2c-4d62-b168-27fb469bfe51 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:47.690642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e546-ab2c-4d62-b168-27fb469bfe51 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:47.690928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e546-ab2c-4d62-b168-27fb469bfe51 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:47.691620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e546-ab2c-4d62-b168-27fb469bfe51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:47.691923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e546-ab2c-4d62-b168-27fb469bfe51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:47.693294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e546-ab2c-4d62-b168-27fb469bfe51 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:47.711005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 549/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:47.934044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ebe0c-23b4-4a42-a3d9-41df0fa027e8 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:47.934334 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ebe0c-23b4-4a42-a3d9-41df0fa027e8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:47.934637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ebe0c-23b4-4a42-a3d9-41df0fa027e8 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:47.936537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 536/1085] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:47.942426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4a985-a4ff-4c36-9022-3d4928c82fa0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:47.942426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4a985-a4ff-4c36-9022-3d4928c82fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:47.942652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4a985-a4ff-4c36-9022-3d4928c82fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:47.961447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d2e4a985-a4ff-4c36-9022-3d4928c82fa0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:47.962547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d2e4a985-a4ff-4c36-9022-3d4928c82fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:48.031483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 550/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:48.053619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ebe0c-23b4-4a42-a3d9-41df0fa027e8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:48.154573 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ebe0c-23b4-4a42-a3d9-41df0fa027e8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:48.187238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bc66f-297d-42f4-836f-ac95a74e1b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:48.187865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bc66f-297d-42f4-836f-ac95a74e1b01 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.188140 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bc66f-297d-42f4-836f-ac95a74e1b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.188410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bc66f-297d-42f4-836f-ac95a74e1b01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.190234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:48.199289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bc66f-297d-42f4-836f-ac95a74e1b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e89bc66f-297d-42f4-836f-ac95a74e1b01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:48.204786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:48.205906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:37:48.206948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:48.210856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 537/1087] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:48.212004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4a985-a4ff-4c36-9022-3d4928c82fa0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:48.280241 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:48.309280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4a985-a4ff-4c36-9022-3d4928c82fa0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:48.343691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392843c-e335-4395-b49c-41320df871ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:48.343992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392843c-e335-4395-b49c-41320df871ee None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.344271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392843c-e335-4395-b49c-41320df871ee None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.344544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392843c-e335-4395-b49c-41320df871ee None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.345262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392843c-e335-4395-b49c-41320df871ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:48.345563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392843c-e335-4395-b49c-41320df871ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:48.347295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392843c-e335-4395-b49c-41320df871ee None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:48.355495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 551/1088] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:48.361935 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bc66f-297d-42f4-836f-ac95a74e1b01 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:48.372149 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434e96a-5140-459b-9332-c3db97b0ca26 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.372436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434e96a-5140-459b-9332-c3db97b0ca26 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.372717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434e96a-5140-459b-9332-c3db97b0ca26 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.374057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 552/1089] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:37:48.378835 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ecbe9-b756-4da8-98b5-5d6c195f86a7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.379142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ecbe9-b756-4da8-98b5-5d6c195f86a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.379412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ecbe9-b756-4da8-98b5-5d6c195f86a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.397215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9f2ecbe9-b756-4da8-98b5-5d6c195f86a7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:48.398408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9f2ecbe9-b756-4da8-98b5-5d6c195f86a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:48.464801 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bc66f-297d-42f4-836f-ac95a74e1b01 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:48.465680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 553/1090] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:48.490134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ecbe9-b756-4da8-98b5-5d6c195f86a7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:48.504552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a59d0-4e72-464a-8c47-b58b0d4fa011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:48.505206 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a59d0-4e72-464a-8c47-b58b0d4fa011 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.505485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a59d0-4e72-464a-8c47-b58b0d4fa011 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.505761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a59d0-4e72-464a-8c47-b58b0d4fa011 None admin] PATH_INFO: `/v3/users/4afcefff5e7c4cdc8882b057919502eb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.506990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a59d0-4e72-464a-8c47-b58b0d4fa011 None admin] RBAC: Authorizing `identity:get_user(user_id=4afcefff5e7c4cdc8882b057919502eb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:48.508423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a59d0-4e72-464a-8c47-b58b0d4fa011 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:48.510045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 538/1091] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:37:48 2022] GET /identity/v3/users/4afcefff5e7c4cdc8882b057919502eb => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:48.515745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a59d0-4e72-464a-8c47-b58b0d4fa011 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:48.552178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:48.579986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:48.590183 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ecbe9-b756-4da8-98b5-5d6c195f86a7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:48.621124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a59d0-4e72-464a-8c47-b58b0d4fa011 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:48.624627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764691b6-6bb4-426d-a54a-428f574e41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:48.625267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764691b6-6bb4-426d-a54a-428f574e41d5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.625549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764691b6-6bb4-426d-a54a-428f574e41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.625823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764691b6-6bb4-426d-a54a-428f574e41d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.636111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764691b6-6bb4-426d-a54a-428f574e41d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-764691b6-6bb4-426d-a54a-428f574e41d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:37:48.641591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:48.642699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:48.643758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 554/1092] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 27 07:37:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:48.648733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764691b6-6bb4-426d-a54a-428f574e41d5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:48.657626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ce14b-bf7e-48a5-8581-5fbbf718f0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:48.658254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ce14b-bf7e-48a5-8581-5fbbf718f0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.658542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ce14b-bf7e-48a5-8581-5fbbf718f0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.658802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ce14b-bf7e-48a5-8581-5fbbf718f0b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.726792 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ce14b-bf7e-48a5-8581-5fbbf718f0b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:48.728185 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ce14b-bf7e-48a5-8581-5fbbf718f0b6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:48.765792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764691b6-6bb4-426d-a54a-428f574e41d5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:48.789949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:48.791585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:48.803178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499456-2bbe-4023-bd00-aca9b29173e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:48.803791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499456-2bbe-4023-bd00-aca9b29173e9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.804067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499456-2bbe-4023-bd00-aca9b29173e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.804337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499456-2bbe-4023-bd00-aca9b29173e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.805105 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499456-2bbe-4023-bd00-aca9b29173e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:48.805480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499456-2bbe-4023-bd00-aca9b29173e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:48.807061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499456-2bbe-4023-bd00-aca9b29173e9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:48.817380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 555/1093] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 27 07:37:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:48.823125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499456-2bbe-4023-bd00-aca9b29173e9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:48.843422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 539/1094] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 07:37:48.844689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ce14b-bf7e-48a5-8581-5fbbf718f0b6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:48.939185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499456-2bbe-4023-bd00-aca9b29173e9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:48.953454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ce14b-bf7e-48a5-8581-5fbbf718f0b6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:48.973472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96b3c8-602b-4ea2-8ce0-c55aac05ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:48.974108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96b3c8-602b-4ea2-8ce0-c55aac05ed79 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.974387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96b3c8-602b-4ea2-8ce0-c55aac05ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.974660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96b3c8-602b-4ea2-8ce0-c55aac05ed79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.985111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96b3c8-602b-4ea2-8ce0-c55aac05ed79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:48.986502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96b3c8-602b-4ea2-8ce0-c55aac05ed79 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:48.987301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb035b-ce6e-4df3-8e21-a3315809eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:48.987942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb035b-ce6e-4df3-8e21-a3315809eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:48.988271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb035b-ce6e-4df3-8e21-a3315809eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:48.988536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb035b-ce6e-4df3-8e21-a3315809eaa1 None admin] PATH_INFO: `/v3/projects/c5731a355f244c49bb60e1349876a983` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:48.989777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb035b-ce6e-4df3-8e21-a3315809eaa1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5731a355f244c49bb60e1349876a983)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:48.991317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb035b-ce6e-4df3-8e21-a3315809eaa1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:48.993014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 540/1095] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:37:48 2022] GET /identity/v3/projects/c5731a355f244c49bb60e1349876a983 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:48.999596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb035b-ce6e-4df3-8e21-a3315809eaa1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-fc96b3c8-602b-4ea2-8ce0-c55aac05ed79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:49.001519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:49.002442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:49.003821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:49.003821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:49.003821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:49.003821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:49.003821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 556/1096] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:49.008175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96b3c8-602b-4ea2-8ce0-c55aac05ed79 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:49.029994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:49.049029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:49.100090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb035b-ce6e-4df3-8e21-a3315809eaa1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:49.111453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96b3c8-602b-4ea2-8ce0-c55aac05ed79 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:49.135213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c11b2-a3b2-4b7f-b1a2-09ec49452ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:49.135828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c11b2-a3b2-4b7f-b1a2-09ec49452ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:49.136105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c11b2-a3b2-4b7f-b1a2-09ec49452ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:49.136424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c11b2-a3b2-4b7f-b1a2-09ec49452ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:49.137218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c11b2-a3b2-4b7f-b1a2-09ec49452ce7 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=c5731a355f244c49bb60e1349876a983, user.id=4afcefff5e7c4cdc8882b057919502eb) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:49.137521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c11b2-a3b2-4b7f-b1a2-09ec49452ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:49.139072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c11b2-a3b2-4b7f-b1a2-09ec49452ce7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:49.144676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 541/1097] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:48 2022] GET /identity/v3/role_assignments?user.id=4afcefff5e7c4cdc8882b057919502eb&scope.project.id=c5731a355f244c49bb60e1349876a983&role.id=2ba3b2926541436a9d26782420538af3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:49.145637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23c10a-b56d-4334-a725-ef8008cf72e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:49.146323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23c10a-b56d-4334-a725-ef8008cf72e8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:49.146606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23c10a-b56d-4334-a725-ef8008cf72e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:49.146893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23c10a-b56d-4334-a725-ef8008cf72e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:49.147603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23c10a-b56d-4334-a725-ef8008cf72e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:49.147909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23c10a-b56d-4334-a725-ef8008cf72e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:49.149293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23c10a-b56d-4334-a725-ef8008cf72e8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:49.162503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 557/1098] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:49.168388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c11b2-a3b2-4b7f-b1a2-09ec49452ce7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:49.271016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:49.279379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c11b2-a3b2-4b7f-b1a2-09ec49452ce7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:49.316030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c1ef4-bfd3-4243-964a-3b09700b8c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:49.316686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c1ef4-bfd3-4243-964a-3b09700b8c43 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:49.316971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c1ef4-bfd3-4243-964a-3b09700b8c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:49.317242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c1ef4-bfd3-4243-964a-3b09700b8c43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:49.325623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c1ef4-bfd3-4243-964a-3b09700b8c43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:49.327119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c1ef4-bfd3-4243-964a-3b09700b8c43 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-3c1c1ef4-bfd3-4243-964a-3b09700b8c43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:37:49.338415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:49.339456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:37:49.340764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 542/1099] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 27 07:37:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:49.346003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23c10a-b56d-4334-a725-ef8008cf72e8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:49.445569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:49.449410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23c10a-b56d-4334-a725-ef8008cf72e8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:49.484058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2f76-ae9b-48a8-b075-e2b034f5b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:49.484671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2f76-ae9b-48a8-b075-e2b034f5b5be None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:49.484955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2f76-ae9b-48a8-b075-e2b034f5b5be None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:49.485228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2f76-ae9b-48a8-b075-e2b034f5b5be None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:49.486023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c2f76-ae9b-48a8-b075-e2b034f5b5be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:49.486333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c2f76-ae9b-48a8-b075-e2b034f5b5be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:49.487810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c2f76-ae9b-48a8-b075-e2b034f5b5be None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:49.505955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 558/1100] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 27 07:37:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:49.511589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c1ef4-bfd3-4243-964a-3b09700b8c43 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:49.619933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c1ef4-bfd3-4243-964a-3b09700b8c43 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:49.653187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e8c79-6042-42a5-8fb2-1e2afab09e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:49.654368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e8c79-6042-42a5-8fb2-1e2afab09e1e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:49.654647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e8c79-6042-42a5-8fb2-1e2afab09e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:49.654938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e8c79-6042-42a5-8fb2-1e2afab09e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:49.679029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:49.724512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e8c79-6042-42a5-8fb2-1e2afab09e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:49.725972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e8c79-6042-42a5-8fb2-1e2afab09e1e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:49.821890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 543/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 07:37:49.828117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2f76-ae9b-48a8-b075-e2b034f5b5be None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:49.928165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2f76-ae9b-48a8-b075-e2b034f5b5be None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:49.962821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd6a89-c751-47c2-8c6c-99d2ee0b0925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:49.963479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd6a89-c751-47c2-8c6c-99d2ee0b0925 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:49.963754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd6a89-c751-47c2-8c6c-99d2ee0b0925 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:49.964023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd6a89-c751-47c2-8c6c-99d2ee0b0925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:49.974248 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd6a89-c751-47c2-8c6c-99d2ee0b0925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:49.975705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd6a89-c751-47c2-8c6c-99d2ee0b0925 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-26cd6a89-c751-47c2-8c6c-99d2ee0b0925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:37:49.989774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:49.990816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:49.992260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:37:49.992260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:37:49.992260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:37:49.992260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:49.992260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 559/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:37:49.996653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e8c79-6042-42a5-8fb2-1e2afab09e1e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:50.050125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:50.095485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e8c79-6042-42a5-8fb2-1e2afab09e1e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:50.130435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb1a1-b753-4e40-b2db-90df6442088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:50.131102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb1a1-b753-4e40-b2db-90df6442088d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:50.131347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb1a1-b753-4e40-b2db-90df6442088d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:50.131618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb1a1-b753-4e40-b2db-90df6442088d None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:50.132313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeb1a1-b753-4e40-b2db-90df6442088d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:50.132619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeb1a1-b753-4e40-b2db-90df6442088d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:50.133978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeb1a1-b753-4e40-b2db-90df6442088d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:50.149568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 544/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:50.150822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd6a89-c751-47c2-8c6c-99d2ee0b0925 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:50.161962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:50.249451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd6a89-c751-47c2-8c6c-99d2ee0b0925 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:50.282086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5553-8efe-4a7f-a113-031f77ea3e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:50.282724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5553-8efe-4a7f-a113-031f77ea3e2a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:50.283030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5553-8efe-4a7f-a113-031f77ea3e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:50.283299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5553-8efe-4a7f-a113-031f77ea3e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:50.289882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c5553-8efe-4a7f-a113-031f77ea3e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:50.291337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c5553-8efe-4a7f-a113-031f77ea3e2a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f44c5553-8efe-4a7f-a113-031f77ea3e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:37:50.303518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:37:50.304696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:37:50.305817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:37:50.305817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:37:50.305817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:37:50.305817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:37:50.305817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:37:50.305817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:37:50.305817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:37:50.305817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:37:50.307066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 560/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:37:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:37:50.311333 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb1a1-b753-4e40-b2db-90df6442088d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:50.412258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb1a1-b753-4e40-b2db-90df6442088d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:50.429627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:50.450499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8d29-6d81-490e-b21a-b50d797924df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:50.451144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8d29-6d81-490e-b21a-b50d797924df None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:50.451429 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8d29-6d81-490e-b21a-b50d797924df None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:50.451705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8d29-6d81-490e-b21a-b50d797924df None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:50.452458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8d29-6d81-490e-b21a-b50d797924df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:50.452765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8d29-6d81-490e-b21a-b50d797924df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:50.454190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8d29-6d81-490e-b21a-b50d797924df None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:50.466515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 545/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:37:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:50.472819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5553-8efe-4a7f-a113-031f77ea3e2a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:50.539086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:50.572396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5553-8efe-4a7f-a113-031f77ea3e2a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:50.608497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046da99-1035-4a45-a0f3-194759380e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:50.609114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046da99-1035-4a45-a0f3-194759380e6d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:50.609390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046da99-1035-4a45-a0f3-194759380e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:50.609663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046da99-1035-4a45-a0f3-194759380e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:50.610460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046da99-1035-4a45-a0f3-194759380e6d None admin] RBAC: Adding query filter params (role.id=62e0df5fca9d4e5189763857170ae97f, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=0445b52b85994510ad9e66de366ebf4d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:50.610766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046da99-1035-4a45-a0f3-194759380e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:50.612282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046da99-1035-4a45-a0f3-194759380e6d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:50.618525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 561/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:50 2022] GET /identity/v3/role_assignments?user.id=0445b52b85994510ad9e66de366ebf4d&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=62e0df5fca9d4e5189763857170ae97f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:37:51.239960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578f06-4b1d-4f4a-9fd3-70d20d93f064 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:51.240477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578f06-4b1d-4f4a-9fd3-70d20d93f064 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:51.240477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578f06-4b1d-4f4a-9fd3-70d20d93f064 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:51.241846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 546/1107] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:51.247764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6308d1e-6812-4257-8639-510fafabe1ea None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:51.248050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6308d1e-6812-4257-8639-510fafabe1ea None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:51.248322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6308d1e-6812-4257-8639-510fafabe1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:51.270416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d6308d1e-6812-4257-8639-510fafabe1ea None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:51.271735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d6308d1e-6812-4257-8639-510fafabe1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:51.346238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 562/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:37:51.371776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578f06-4b1d-4f4a-9fd3-70d20d93f064 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:51.481420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578f06-4b1d-4f4a-9fd3-70d20d93f064 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:51.514829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9163be7-5108-4924-97dd-460b1bbef707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:51.515490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9163be7-5108-4924-97dd-460b1bbef707 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:51.515777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9163be7-5108-4924-97dd-460b1bbef707 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:51.516050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9163be7-5108-4924-97dd-460b1bbef707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:51.517204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9163be7-5108-4924-97dd-460b1bbef707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:51.518646 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9163be7-5108-4924-97dd-460b1bbef707 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:51.520272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 547/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:37:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:51.526079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6308d1e-6812-4257-8639-510fafabe1ea None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:51.592095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:51.629483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6308d1e-6812-4257-8639-510fafabe1ea None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:51.667622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a279812-8850-4b9a-b49a-f1dbb4a4f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:51.668229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a279812-8850-4b9a-b49a-f1dbb4a4f641 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:51.668510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a279812-8850-4b9a-b49a-f1dbb4a4f641 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:51.668782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a279812-8850-4b9a-b49a-f1dbb4a4f641 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:51.669459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a279812-8850-4b9a-b49a-f1dbb4a4f641 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:51.670917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a279812-8850-4b9a-b49a-f1dbb4a4f641 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:51.691472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 563/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:37:51 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:37:53.756924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b43e-d958-4935-903f-de983fbee749 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:53.757432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b43e-d958-4935-903f-de983fbee749 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:53.757432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b43e-d958-4935-903f-de983fbee749 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:53.758696 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 548/1111] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:53.763858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369a1b9-647a-43dd-8013-f9d92e59cd94 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:53.764286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369a1b9-647a-43dd-8013-f9d92e59cd94 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:53.764410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369a1b9-647a-43dd-8013-f9d92e59cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:53.783015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0369a1b9-647a-43dd-8013-f9d92e59cd94 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:53.784209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0369a1b9-647a-43dd-8013-f9d92e59cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:53.850731 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 564/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:53.873386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b43e-d958-4935-903f-de983fbee749 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:53.918323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:53.974379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b43e-d958-4935-903f-de983fbee749 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:54.007020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aabbd-d499-4c68-8a32-5853f68ed9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:54.007589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aabbd-d499-4c68-8a32-5853f68ed9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:54.007866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aabbd-d499-4c68-8a32-5853f68ed9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:54.008135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aabbd-d499-4c68-8a32-5853f68ed9b4 None admin] PATH_INFO: `/v3/roles/d37aa78d5c9d411886137e9cdff24857` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:54.009652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aabbd-d499-4c68-8a32-5853f68ed9b4 None admin] RBAC: Authorizing `identity:get_role(role_id=d37aa78d5c9d411886137e9cdff24857)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:54.011068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aabbd-d499-4c68-8a32-5853f68ed9b4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:54.012887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 549/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:37:53 2022] GET /identity/v3/roles/d37aa78d5c9d411886137e9cdff24857 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:54.018945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369a1b9-647a-43dd-8013-f9d92e59cd94 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:54.065713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:54.116769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369a1b9-647a-43dd-8013-f9d92e59cd94 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:54.150243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e478513-f0bd-470e-bf14-4b73de3afb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:54.150904 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478513-f0bd-470e-bf14-4b73de3afb8b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:54.151186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478513-f0bd-470e-bf14-4b73de3afb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:54.151456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478513-f0bd-470e-bf14-4b73de3afb8b None admin] PATH_INFO: `/v3/users/3f9effa1a17a4466b38af21c7fc14fba` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:54.164760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e478513-f0bd-470e-bf14-4b73de3afb8b None admin] RBAC: Authorizing `identity:get_user(user_id=3f9effa1a17a4466b38af21c7fc14fba)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:54.166191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e478513-f0bd-470e-bf14-4b73de3afb8b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:54.167856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 565/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:37:54 2022] GET /identity/v3/users/3f9effa1a17a4466b38af21c7fc14fba => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:54.173648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aabbd-d499-4c68-8a32-5853f68ed9b4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:54.273401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aabbd-d499-4c68-8a32-5853f68ed9b4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:54.284085 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:54.307317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa1576-5578-4aaf-8215-75b25c1da718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:54.307934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa1576-5578-4aaf-8215-75b25c1da718 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:54.308214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa1576-5578-4aaf-8215-75b25c1da718 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:54.308486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa1576-5578-4aaf-8215-75b25c1da718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:54.373859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa1576-5578-4aaf-8215-75b25c1da718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:54.375336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa1576-5578-4aaf-8215-75b25c1da718 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:54.472733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 550/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:37:54.478664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e478513-f0bd-470e-bf14-4b73de3afb8b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:54.579752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e478513-f0bd-470e-bf14-4b73de3afb8b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:54.586962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:54.613687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513fd88-df5e-480e-be62-ae3999500d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:54.614340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fd88-df5e-480e-be62-ae3999500d5f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:54.614622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fd88-df5e-480e-be62-ae3999500d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:54.614916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fd88-df5e-480e-be62-ae3999500d5f None admin] PATH_INFO: `/v3/projects/c5731a355f244c49bb60e1349876a983` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:54.616102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513fd88-df5e-480e-be62-ae3999500d5f None admin] RBAC: Authorizing `identity:get_project(project_id=c5731a355f244c49bb60e1349876a983)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:54.617534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513fd88-df5e-480e-be62-ae3999500d5f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:54.619233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 566/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:37:54 2022] GET /identity/v3/projects/c5731a355f244c49bb60e1349876a983 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:54.625981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa1576-5578-4aaf-8215-75b25c1da718 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:54.637515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:54.722335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa1576-5578-4aaf-8215-75b25c1da718 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:54.755373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810823e8-9449-4da5-b320-7b6dddb285d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:54.755981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810823e8-9449-4da5-b320-7b6dddb285d3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:54.756261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810823e8-9449-4da5-b320-7b6dddb285d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:54.757063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810823e8-9449-4da5-b320-7b6dddb285d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:54.757668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810823e8-9449-4da5-b320-7b6dddb285d3 None admin] RBAC: Adding query filter params (role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=c5731a355f244c49bb60e1349876a983, user.id=3f9effa1a17a4466b38af21c7fc14fba) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:37:54.757668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810823e8-9449-4da5-b320-7b6dddb285d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:54.759048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810823e8-9449-4da5-b320-7b6dddb285d3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:54.764994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 551/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:37:54 2022] GET /identity/v3/role_assignments?user.id=3f9effa1a17a4466b38af21c7fc14fba&scope.project.id=c5731a355f244c49bb60e1349876a983&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:56.759313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18930c13-28d7-47ba-9d61-64d066518991 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:56.759866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18930c13-28d7-47ba-9d61-64d066518991 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:56.759866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18930c13-28d7-47ba-9d61-64d066518991 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:56.761137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 567/1118] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:56.766867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc328d-5999-442f-be06-6e78c27063e9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:56.767324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc328d-5999-442f-be06-6e78c27063e9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:56.767430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc328d-5999-442f-be06-6e78c27063e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:56.785032 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eacc328d-5999-442f-be06-6e78c27063e9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:56.786205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eacc328d-5999-442f-be06-6e78c27063e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:56.850222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 552/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:56.873379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18930c13-28d7-47ba-9d61-64d066518991 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:56.973854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18930c13-28d7-47ba-9d61-64d066518991 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:57.007227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84785-1894-4ab2-966c-c6b9fa2818ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:57.007864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84785-1894-4ab2-966c-c6b9fa2818ab None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:57.008144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84785-1894-4ab2-966c-c6b9fa2818ab None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:57.008420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84785-1894-4ab2-966c-c6b9fa2818ab None admin] PATH_INFO: `/v3/roles/d37aa78d5c9d411886137e9cdff24857` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:57.009911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a84785-1894-4ab2-966c-c6b9fa2818ab None admin] RBAC: Authorizing `identity:get_role(role_id=d37aa78d5c9d411886137e9cdff24857)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:57.011258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a84785-1894-4ab2-966c-c6b9fa2818ab None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:57.012623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 568/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:37:56 2022] GET /identity/v3/roles/d37aa78d5c9d411886137e9cdff24857 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:57.018767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc328d-5999-442f-be06-6e78c27063e9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:57.021859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:57.114193 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc328d-5999-442f-be06-6e78c27063e9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:57.147782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda05f3f-60d4-46f4-957a-4e79071ed3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:57.148411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda05f3f-60d4-46f4-957a-4e79071ed3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:57.148687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda05f3f-60d4-46f4-957a-4e79071ed3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:57.148956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda05f3f-60d4-46f4-957a-4e79071ed3e3 None admin] PATH_INFO: `/v3/users/3f9effa1a17a4466b38af21c7fc14fba` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:57.150108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda05f3f-60d4-46f4-957a-4e79071ed3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=3f9effa1a17a4466b38af21c7fc14fba)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:57.151550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda05f3f-60d4-46f4-957a-4e79071ed3e3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:57.153150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 553/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:37:57 2022] GET /identity/v3/users/3f9effa1a17a4466b38af21c7fc14fba => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:57.159180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84785-1894-4ab2-966c-c6b9fa2818ab None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:57.201532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:57.257635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84785-1894-4ab2-966c-c6b9fa2818ab None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:57.290077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4784e-09d4-4472-8e3a-c6205b6653f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:57.290644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4784e-09d4-4472-8e3a-c6205b6653f5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:57.290939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4784e-09d4-4472-8e3a-c6205b6653f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:57.291210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4784e-09d4-4472-8e3a-c6205b6653f5 None admin] PATH_INFO: `/v3/projects/c5731a355f244c49bb60e1349876a983` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:57.292350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4784e-09d4-4472-8e3a-c6205b6653f5 None admin] RBAC: Authorizing `identity:get_project(project_id=c5731a355f244c49bb60e1349876a983)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:57.294319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4784e-09d4-4472-8e3a-c6205b6653f5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:57.295990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 569/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:37:57 2022] GET /identity/v3/projects/c5731a355f244c49bb60e1349876a983 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:57.301892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda05f3f-60d4-46f4-957a-4e79071ed3e3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:57.368967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:57.399271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda05f3f-60d4-46f4-957a-4e79071ed3e3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:57.436080 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72125f12-21ea-4939-8b16-152b53937ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:57.436753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72125f12-21ea-4939-8b16-152b53937ff1 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:57.437036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72125f12-21ea-4939-8b16-152b53937ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:57.437311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72125f12-21ea-4939-8b16-152b53937ff1 None admin] PATH_INFO: `/v3/projects/c5731a355f244c49bb60e1349876a983/users/3f9effa1a17a4466b38af21c7fc14fba/roles/d37aa78d5c9d411886137e9cdff24857` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:57.439517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72125f12-21ea-4939-8b16-152b53937ff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5731a355f244c49bb60e1349876a983, user_id=3f9effa1a17a4466b38af21c7fc14fba, role_id=d37aa78d5c9d411886137e9cdff24857)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:57.440953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72125f12-21ea-4939-8b16-152b53937ff1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:57.453319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 554/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:37:57 2022] PUT /identity/v3/projects/c5731a355f244c49bb60e1349876a983/users/3f9effa1a17a4466b38af21c7fc14fba/roles/d37aa78d5c9d411886137e9cdff24857 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:37:59.421991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f384ce3-1e0e-48e8-83e6-4454a7c52eaf None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:59.422549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f384ce3-1e0e-48e8-83e6-4454a7c52eaf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:59.422549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f384ce3-1e0e-48e8-83e6-4454a7c52eaf None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:59.423926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 570/1124] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:37:59.429345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a8cad-0613-4552-a1aa-506eb29ff382 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:59.429770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a8cad-0613-4552-a1aa-506eb29ff382 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:59.429869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a8cad-0613-4552-a1aa-506eb29ff382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:59.447686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fa7a8cad-0613-4552-a1aa-506eb29ff382 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:37:59.448872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa7a8cad-0613-4552-a1aa-506eb29ff382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:37:59.515865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 555/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:37:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:37:59.538630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f384ce3-1e0e-48e8-83e6-4454a7c52eaf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:59.638312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f384ce3-1e0e-48e8-83e6-4454a7c52eaf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:59.649391 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:59.673650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f183-94fb-4e79-9d13-dacc0a888131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:59.674205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f183-94fb-4e79-9d13-dacc0a888131 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:59.674487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f183-94fb-4e79-9d13-dacc0a888131 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:59.674763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f183-94fb-4e79-9d13-dacc0a888131 None admin] PATH_INFO: `/v3/roles/d37aa78d5c9d411886137e9cdff24857` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:59.676299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77f183-94fb-4e79-9d13-dacc0a888131 None admin] RBAC: Authorizing `identity:get_role(role_id=d37aa78d5c9d411886137e9cdff24857)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:59.677673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77f183-94fb-4e79-9d13-dacc0a888131 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:59.679048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 571/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:37:59 2022] GET /identity/v3/roles/d37aa78d5c9d411886137e9cdff24857 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:59.685470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a8cad-0613-4552-a1aa-506eb29ff382 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:59.744928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:37:59.784869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a8cad-0613-4552-a1aa-506eb29ff382 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:59.817317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d705be-4181-479d-afab-c3d1cd215689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:59.817953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d705be-4181-479d-afab-c3d1cd215689 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:59.818231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d705be-4181-479d-afab-c3d1cd215689 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:59.818502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d705be-4181-479d-afab-c3d1cd215689 None admin] PATH_INFO: `/v3/users/3f9effa1a17a4466b38af21c7fc14fba` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:37:59.819705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d705be-4181-479d-afab-c3d1cd215689 None admin] RBAC: Authorizing `identity:get_user(user_id=3f9effa1a17a4466b38af21c7fc14fba)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:37:59.821136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d705be-4181-479d-afab-c3d1cd215689 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:37:59.822723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 556/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:37:59 2022] GET /identity/v3/users/3f9effa1a17a4466b38af21c7fc14fba => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:37:59.829092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f183-94fb-4e79-9d13-dacc0a888131 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:37:59.927796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f183-94fb-4e79-9d13-dacc0a888131 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:37:59.960455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a0410-bff5-489c-9dbe-0774c49aa352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:37:59.961059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a0410-bff5-489c-9dbe-0774c49aa352 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:37:59.961335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a0410-bff5-489c-9dbe-0774c49aa352 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:37:59.961603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a0410-bff5-489c-9dbe-0774c49aa352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:00.020212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:00.042189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a0410-bff5-489c-9dbe-0774c49aa352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:00.044367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a0410-bff5-489c-9dbe-0774c49aa352 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:00.151807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 572/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:37:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 07:38:00.157786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d705be-4181-479d-afab-c3d1cd215689 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:00.254727 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d705be-4181-479d-afab-c3d1cd215689 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:00.283023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:00.288929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbe429-6f09-4c4e-87d8-cca216bc912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:00.289565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbe429-6f09-4c4e-87d8-cca216bc912b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:00.289841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbe429-6f09-4c4e-87d8-cca216bc912b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:00.290109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbe429-6f09-4c4e-87d8-cca216bc912b None admin] PATH_INFO: `/v3/projects/c5731a355f244c49bb60e1349876a983` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:00.291290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbe429-6f09-4c4e-87d8-cca216bc912b None admin] RBAC: Authorizing `identity:get_project(project_id=c5731a355f244c49bb60e1349876a983)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:00.292707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbe429-6f09-4c4e-87d8-cca216bc912b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:00.294949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 557/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:38:00 2022] GET /identity/v3/projects/c5731a355f244c49bb60e1349876a983 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:00.301063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a0410-bff5-489c-9dbe-0774c49aa352 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:00.380326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:00.401175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a0410-bff5-489c-9dbe-0774c49aa352 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:00.435443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867e92e-0e98-4570-948a-50b2c9b586f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:00.436054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e92e-0e98-4570-948a-50b2c9b586f6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:00.436331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e92e-0e98-4570-948a-50b2c9b586f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:00.436602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e92e-0e98-4570-948a-50b2c9b586f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:00.437386 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e92e-0e98-4570-948a-50b2c9b586f6 None admin] RBAC: Adding query filter params (role.id=d37aa78d5c9d411886137e9cdff24857, scope.project.id=c5731a355f244c49bb60e1349876a983, user.id=3f9effa1a17a4466b38af21c7fc14fba) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:00.437690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e92e-0e98-4570-948a-50b2c9b586f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:00.439135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e92e-0e98-4570-948a-50b2c9b586f6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:00.444956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 573/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:38:00 2022] GET /identity/v3/role_assignments?user.id=3f9effa1a17a4466b38af21c7fc14fba&scope.project.id=c5731a355f244c49bb60e1349876a983&role.id=d37aa78d5c9d411886137e9cdff24857 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:02.464841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959425f5-ecbe-4557-93e2-7ac79ee0d6fe None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:02.465948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959425f5-ecbe-4557-93e2-7ac79ee0d6fe None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:02.466062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959425f5-ecbe-4557-93e2-7ac79ee0d6fe None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:02.467390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 558/1131] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:02.472728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6c733-bbab-453d-91bd-7d3c62e35d73 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:02.473151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6c733-bbab-453d-91bd-7d3c62e35d73 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:02.473256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6c733-bbab-453d-91bd-7d3c62e35d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:02.491761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c6e6c733-bbab-453d-91bd-7d3c62e35d73 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:02.492941 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c6e6c733-bbab-453d-91bd-7d3c62e35d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:02.557802 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 574/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:02.581388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959425f5-ecbe-4557-93e2-7ac79ee0d6fe None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:02.681553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959425f5-ecbe-4557-93e2-7ac79ee0d6fe None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:02.713824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da59f99-b156-4218-a480-ba082f5151aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:02.714462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da59f99-b156-4218-a480-ba082f5151aa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:02.714742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da59f99-b156-4218-a480-ba082f5151aa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:02.715041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da59f99-b156-4218-a480-ba082f5151aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:02.716785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da59f99-b156-4218-a480-ba082f5151aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:02.718208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da59f99-b156-4218-a480-ba082f5151aa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:02.719811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 559/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:38:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:02.726035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6c733-bbab-453d-91bd-7d3c62e35d73 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:02.794132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:02.822614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6c733-bbab-453d-91bd-7d3c62e35d73 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:02.856720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0d75-4d97-4c96-9811-9d390af305dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:02.857328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0d75-4d97-4c96-9811-9d390af305dd None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:02.857606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0d75-4d97-4c96-9811-9d390af305dd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:02.857874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0d75-4d97-4c96-9811-9d390af305dd None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:02.858552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a0d75-4d97-4c96-9811-9d390af305dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:02.860010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a0d75-4d97-4c96-9811-9d390af305dd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:02.885252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 575/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:38:02 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:38:04.889700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2ef38-6767-4185-a9ef-c0f1ebb96852 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:04.890274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2ef38-6767-4185-a9ef-c0f1ebb96852 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:04.890274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2ef38-6767-4185-a9ef-c0f1ebb96852 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:04.891582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 560/1135] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:04.896918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81943-b0c3-481f-87a2-519d7e4029e6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:04.897308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81943-b0c3-481f-87a2-519d7e4029e6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:04.897476 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81943-b0c3-481f-87a2-519d7e4029e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:04.915356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d9f81943-b0c3-481f-87a2-519d7e4029e6 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:04.916545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d9f81943-b0c3-481f-87a2-519d7e4029e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:04.983069 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 576/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:05.006697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2ef38-6767-4185-a9ef-c0f1ebb96852 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:05.072698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:05.109998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2ef38-6767-4185-a9ef-c0f1ebb96852 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:05.145964 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70796f45-baa5-4cde-96d6-f04fae210e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:05.146522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796f45-baa5-4cde-96d6-f04fae210e03 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:05.146798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796f45-baa5-4cde-96d6-f04fae210e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:05.147101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796f45-baa5-4cde-96d6-f04fae210e03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:05.148267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70796f45-baa5-4cde-96d6-f04fae210e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:05.149696 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70796f45-baa5-4cde-96d6-f04fae210e03 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:05.151331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 561/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:05.157733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81943-b0c3-481f-87a2-519d7e4029e6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:05.211514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:05.255977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81943-b0c3-481f-87a2-519d7e4029e6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:05.289667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f0d4a-a6bc-432e-813a-3098b788c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:05.290276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0d4a-a6bc-432e-813a-3098b788c023 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:05.290552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0d4a-a6bc-432e-813a-3098b788c023 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:05.290823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0d4a-a6bc-432e-813a-3098b788c023 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:05.291537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f0d4a-a6bc-432e-813a-3098b788c023 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:05.292971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f0d4a-a6bc-432e-813a-3098b788c023 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:05.313684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 577/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:38:05 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:38:07.328709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e03e7-d3cb-4791-8468-779c038755dd None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:07.329263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e03e7-d3cb-4791-8468-779c038755dd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:07.329263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e03e7-d3cb-4791-8468-779c038755dd None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:07.330567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 562/1139] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:07.335724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed3c2-02d0-4e0e-a7c7-02fa258bd6fb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:07.336214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed3c2-02d0-4e0e-a7c7-02fa258bd6fb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:07.336321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed3c2-02d0-4e0e-a7c7-02fa258bd6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:07.354298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-eefed3c2-02d0-4e0e-a7c7-02fa258bd6fb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:07.355514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-eefed3c2-02d0-4e0e-a7c7-02fa258bd6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:07.423361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 578/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:38:07.446708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e03e7-d3cb-4791-8468-779c038755dd None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:07.544523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e03e7-d3cb-4791-8468-779c038755dd None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:07.579548 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5523592-629d-49cb-80fa-2044e3c9024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:07.580115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5523592-629d-49cb-80fa-2044e3c9024d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:07.580394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5523592-629d-49cb-80fa-2044e3c9024d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:07.580665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5523592-629d-49cb-80fa-2044e3c9024d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:07.582543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:07.592415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5523592-629d-49cb-80fa-2044e3c9024d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d5523592-629d-49cb-80fa-2044e3c9024d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:38:07.597523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:38:07.598674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:38:07.599985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 563/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:38:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:38:07.604769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefed3c2-02d0-4e0e-a7c7-02fa258bd6fb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:07.645229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:07.702773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefed3c2-02d0-4e0e-a7c7-02fa258bd6fb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:07.736082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3835a85-c362-4d48-aced-55f7f3945a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:07.737142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3835a85-c362-4d48-aced-55f7f3945a0c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:07.737142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3835a85-c362-4d48-aced-55f7f3945a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:07.737405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3835a85-c362-4d48-aced-55f7f3945a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:07.737953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3835a85-c362-4d48-aced-55f7f3945a0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:07.738260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3835a85-c362-4d48-aced-55f7f3945a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:07.739670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3835a85-c362-4d48-aced-55f7f3945a0c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:07.748363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 579/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:38:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:07.754135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5523592-629d-49cb-80fa-2044e3c9024d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:07.852131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5523592-629d-49cb-80fa-2044e3c9024d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:07.885535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722a088-52f8-4dc8-b85f-90bb909e6c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:07.886179 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722a088-52f8-4dc8-b85f-90bb909e6c2f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:07.886459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722a088-52f8-4dc8-b85f-90bb909e6c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:07.886734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722a088-52f8-4dc8-b85f-90bb909e6c2f None admin] PATH_INFO: `/v3/users/3e9d3abd81ca412599435d5ceaf2866b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:07.900818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722a088-52f8-4dc8-b85f-90bb909e6c2f None admin] RBAC: Authorizing `identity:get_user(user_id=3e9d3abd81ca412599435d5ceaf2866b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:07.902268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722a088-52f8-4dc8-b85f-90bb909e6c2f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:07.903960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 564/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:38:07 2022] GET /identity/v3/users/3e9d3abd81ca412599435d5ceaf2866b => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:07.909865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3835a85-c362-4d48-aced-55f7f3945a0c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:08.010834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3835a85-c362-4d48-aced-55f7f3945a0c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:08.012973 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:08.045034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beee46-34e5-43b1-bf28-d1915a511291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:08.045643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beee46-34e5-43b1-bf28-d1915a511291 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:08.045923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beee46-34e5-43b1-bf28-d1915a511291 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:08.046194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beee46-34e5-43b1-bf28-d1915a511291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:08.113007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beee46-34e5-43b1-bf28-d1915a511291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:08.114418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beee46-34e5-43b1-bf28-d1915a511291 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:08.210187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 580/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:38:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 07:38:08.216328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722a088-52f8-4dc8-b85f-90bb909e6c2f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:08.268336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:08.315749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722a088-52f8-4dc8-b85f-90bb909e6c2f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:08.348979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190304b-5906-4438-a86d-23706344411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:08.349618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190304b-5906-4438-a86d-23706344411e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:08.349898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190304b-5906-4438-a86d-23706344411e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:08.350171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190304b-5906-4438-a86d-23706344411e None admin] PATH_INFO: `/v3/projects/23983865eb4e45aa9901bd8261331d42` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:08.351356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190304b-5906-4438-a86d-23706344411e None admin] RBAC: Authorizing `identity:get_project(project_id=23983865eb4e45aa9901bd8261331d42)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:08.352787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190304b-5906-4438-a86d-23706344411e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:08.354442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 565/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:38:08 2022] GET /identity/v3/projects/23983865eb4e45aa9901bd8261331d42 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:08.361404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beee46-34e5-43b1-bf28-d1915a511291 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:08.363751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:08.471284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beee46-34e5-43b1-bf28-d1915a511291 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:08.505221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01515-4a38-4063-a6de-af565686ad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:08.505831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01515-4a38-4063-a6de-af565686ad39 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:08.506110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01515-4a38-4063-a6de-af565686ad39 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:08.506381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01515-4a38-4063-a6de-af565686ad39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:08.507206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01515-4a38-4063-a6de-af565686ad39 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=23983865eb4e45aa9901bd8261331d42, user.id=3e9d3abd81ca412599435d5ceaf2866b) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:08.507516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01515-4a38-4063-a6de-af565686ad39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:08.508957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01515-4a38-4063-a6de-af565686ad39 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:08.514429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 581/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:38:08 2022] GET /identity/v3/role_assignments?user.id=3e9d3abd81ca412599435d5ceaf2866b&scope.project.id=23983865eb4e45aa9901bd8261331d42&role.id=2ba3b2926541436a9d26782420538af3 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:10.491845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07aa9-eaee-4044-a8c0-c17ce9acb5eb None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:10.492371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07aa9-eaee-4044-a8c0-c17ce9acb5eb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:10.492371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07aa9-eaee-4044-a8c0-c17ce9acb5eb None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:10.493692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 566/1147] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:10.499632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666bcb-2980-4fea-ac43-f1c94a9131fd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:10.500044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666bcb-2980-4fea-ac43-f1c94a9131fd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:10.500169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666bcb-2980-4fea-ac43-f1c94a9131fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:10.517797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a6666bcb-2980-4fea-ac43-f1c94a9131fd None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:10.519016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a6666bcb-2980-4fea-ac43-f1c94a9131fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:10.576419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:10.583947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 582/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:10.606563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd07aa9-eaee-4044-a8c0-c17ce9acb5eb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:10.705231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd07aa9-eaee-4044-a8c0-c17ce9acb5eb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:10.725079 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:10.739118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f35756-c46a-40d6-8cd2-df5464bc5229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:10.739746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f35756-c46a-40d6-8cd2-df5464bc5229 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:10.740019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f35756-c46a-40d6-8cd2-df5464bc5229 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:10.740282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f35756-c46a-40d6-8cd2-df5464bc5229 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:10.750297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f35756-c46a-40d6-8cd2-df5464bc5229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b2f35756-c46a-40d6-8cd2-df5464bc5229 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:38:10.755129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:38:10.756307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:38:10.757542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 567/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:38:10.762388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666bcb-2980-4fea-ac43-f1c94a9131fd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:10.859324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666bcb-2980-4fea-ac43-f1c94a9131fd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:10.891681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffd61e-84a1-48fa-a581-69652676a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:10.892299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffd61e-84a1-48fa-a581-69652676a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:10.892581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffd61e-84a1-48fa-a581-69652676a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:10.892854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffd61e-84a1-48fa-a581-69652676a2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:10.893570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffd61e-84a1-48fa-a581-69652676a2a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:10.893871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffd61e-84a1-48fa-a581-69652676a2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:10.895273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffd61e-84a1-48fa-a581-69652676a2a8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:10.903974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 583/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:10.909813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f35756-c46a-40d6-8cd2-df5464bc5229 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:11.014446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f35756-c46a-40d6-8cd2-df5464bc5229 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:11.049351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502a9f4-10dc-4cd5-8fb9-0eac48717c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:11.049998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502a9f4-10dc-4cd5-8fb9-0eac48717c2e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:11.050277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502a9f4-10dc-4cd5-8fb9-0eac48717c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:11.050547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502a9f4-10dc-4cd5-8fb9-0eac48717c2e None admin] PATH_INFO: `/v3/users/3e9d3abd81ca412599435d5ceaf2866b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:11.051763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502a9f4-10dc-4cd5-8fb9-0eac48717c2e None admin] RBAC: Authorizing `identity:get_user(user_id=3e9d3abd81ca412599435d5ceaf2866b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:11.053183 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502a9f4-10dc-4cd5-8fb9-0eac48717c2e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:11.054789 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 568/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:38:10 2022] GET /identity/v3/users/3e9d3abd81ca412599435d5ceaf2866b => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:11.060691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffd61e-84a1-48fa-a581-69652676a2a8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:11.125081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:11.168860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffd61e-84a1-48fa-a581-69652676a2a8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:11.202711 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e108d-1ddb-4b18-8d4a-acc132b0799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:11.203368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e108d-1ddb-4b18-8d4a-acc132b0799f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:11.203648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e108d-1ddb-4b18-8d4a-acc132b0799f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:11.203921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e108d-1ddb-4b18-8d4a-acc132b0799f None admin] PATH_INFO: `/v3/projects/23983865eb4e45aa9901bd8261331d42` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:11.205064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e108d-1ddb-4b18-8d4a-acc132b0799f None admin] RBAC: Authorizing `identity:get_project(project_id=23983865eb4e45aa9901bd8261331d42)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:11.206491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e108d-1ddb-4b18-8d4a-acc132b0799f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:11.208200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 584/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:38:11 2022] GET /identity/v3/projects/23983865eb4e45aa9901bd8261331d42 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:11.214325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502a9f4-10dc-4cd5-8fb9-0eac48717c2e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:11.263287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:11.312915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502a9f4-10dc-4cd5-8fb9-0eac48717c2e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:11.346928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8fa5d-f6ea-4431-a9d8-cc16bcc9748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:11.347592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8fa5d-f6ea-4431-a9d8-cc16bcc9748f None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:11.347871 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8fa5d-f6ea-4431-a9d8-cc16bcc9748f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:11.348140 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8fa5d-f6ea-4431-a9d8-cc16bcc9748f None admin] PATH_INFO: `/v3/projects/23983865eb4e45aa9901bd8261331d42/users/3e9d3abd81ca412599435d5ceaf2866b/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:11.350092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8fa5d-f6ea-4431-a9d8-cc16bcc9748f None admin] RBAC: Authorizing `identity:create_grant(project_id=23983865eb4e45aa9901bd8261331d42, user_id=3e9d3abd81ca412599435d5ceaf2866b, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:11.351550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8fa5d-f6ea-4431-a9d8-cc16bcc9748f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:11.365157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 569/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:38:11 2022] PUT /identity/v3/projects/23983865eb4e45aa9901bd8261331d42/users/3e9d3abd81ca412599435d5ceaf2866b/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:38:13.375397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88bf4-b010-44d6-b1d6-edff83528cce None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:13.375964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88bf4-b010-44d6-b1d6-edff83528cce None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:13.375964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88bf4-b010-44d6-b1d6-edff83528cce None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:13.377278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 585/1154] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:13.382707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198e458-811a-437d-ace9-31efb1401438 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:13.383151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198e458-811a-437d-ace9-31efb1401438 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:13.383302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198e458-811a-437d-ace9-31efb1401438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:13.401492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0198e458-811a-437d-ace9-31efb1401438 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:13.403305 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0198e458-811a-437d-ace9-31efb1401438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:13.469331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 570/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:13.492511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88bf4-b010-44d6-b1d6-edff83528cce None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:13.594209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88bf4-b010-44d6-b1d6-edff83528cce None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:13.619407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:13.628453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27a96c-8ad7-441b-ac39-e53d559cd38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:13.629031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27a96c-8ad7-441b-ac39-e53d559cd38f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:13.629313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27a96c-8ad7-441b-ac39-e53d559cd38f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:13.629588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27a96c-8ad7-441b-ac39-e53d559cd38f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:13.640188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27a96c-8ad7-441b-ac39-e53d559cd38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ba27a96c-8ad7-441b-ac39-e53d559cd38f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:38:13.645077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:38:13.646158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:38:13.647040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 586/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:38:13.653125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198e458-811a-437d-ace9-31efb1401438 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:13.691107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:13.752470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198e458-811a-437d-ace9-31efb1401438 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:13.786453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12598526-59f2-40cc-b4f3-313b484c1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:13.787098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12598526-59f2-40cc-b4f3-313b484c1dce None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:13.787382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12598526-59f2-40cc-b4f3-313b484c1dce None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:13.787654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12598526-59f2-40cc-b4f3-313b484c1dce None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:13.788387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12598526-59f2-40cc-b4f3-313b484c1dce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:13.788684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12598526-59f2-40cc-b4f3-313b484c1dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:13.790050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12598526-59f2-40cc-b4f3-313b484c1dce None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:13.797902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 571/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:13.803888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27a96c-8ad7-441b-ac39-e53d559cd38f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:13.905820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27a96c-8ad7-441b-ac39-e53d559cd38f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:13.940556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a8511-a335-4e62-94ae-1dd5a46da574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:13.941191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a8511-a335-4e62-94ae-1dd5a46da574 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:13.941468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a8511-a335-4e62-94ae-1dd5a46da574 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:13.941736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a8511-a335-4e62-94ae-1dd5a46da574 None admin] PATH_INFO: `/v3/users/3e9d3abd81ca412599435d5ceaf2866b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:13.942925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a8511-a335-4e62-94ae-1dd5a46da574 None admin] RBAC: Authorizing `identity:get_user(user_id=3e9d3abd81ca412599435d5ceaf2866b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:13.944357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a8511-a335-4e62-94ae-1dd5a46da574 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:13.945965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 587/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:38:13 2022] GET /identity/v3/users/3e9d3abd81ca412599435d5ceaf2866b => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:13.953519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12598526-59f2-40cc-b4f3-313b484c1dce None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:14.050416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:14.053256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12598526-59f2-40cc-b4f3-313b484c1dce None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:14.088131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0e375-6738-4c5d-9ac6-4219454351ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:14.088746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0e375-6738-4c5d-9ac6-4219454351ce None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:14.089028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0e375-6738-4c5d-9ac6-4219454351ce None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:14.089311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0e375-6738-4c5d-9ac6-4219454351ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:14.165988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0e375-6738-4c5d-9ac6-4219454351ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:14.167393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0e375-6738-4c5d-9ac6-4219454351ce None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:14.269643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:14.276828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 572/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:38:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:38:14.280106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a8511-a335-4e62-94ae-1dd5a46da574 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:14.340241 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:14.387528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a8511-a335-4e62-94ae-1dd5a46da574 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:14.423341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66899a4a-bc96-41ef-81bc-a7c6b5ffd058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:14.423924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66899a4a-bc96-41ef-81bc-a7c6b5ffd058 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:14.424403 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66899a4a-bc96-41ef-81bc-a7c6b5ffd058 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:14.424857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66899a4a-bc96-41ef-81bc-a7c6b5ffd058 None admin] PATH_INFO: `/v3/projects/23983865eb4e45aa9901bd8261331d42` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:14.426320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66899a4a-bc96-41ef-81bc-a7c6b5ffd058 None admin] RBAC: Authorizing `identity:get_project(project_id=23983865eb4e45aa9901bd8261331d42)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:14.427554 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66899a4a-bc96-41ef-81bc-a7c6b5ffd058 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:14.429227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 588/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:38:14 2022] GET /identity/v3/projects/23983865eb4e45aa9901bd8261331d42 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:14.436112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0e375-6738-4c5d-9ac6-4219454351ce None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:14.551366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0e375-6738-4c5d-9ac6-4219454351ce None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:14.584632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc55393-0bad-453d-8721-32f9fa9ee992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:14.585261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55393-0bad-453d-8721-32f9fa9ee992 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:14.585655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55393-0bad-453d-8721-32f9fa9ee992 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:14.586032 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55393-0bad-453d-8721-32f9fa9ee992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:14.586867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc55393-0bad-453d-8721-32f9fa9ee992 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=23983865eb4e45aa9901bd8261331d42, user.id=3e9d3abd81ca412599435d5ceaf2866b) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:14.587201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc55393-0bad-453d-8721-32f9fa9ee992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:14.588643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc55393-0bad-453d-8721-32f9fa9ee992 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:14.596176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 573/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:38:14 2022] GET /identity/v3/role_assignments?user.id=3e9d3abd81ca412599435d5ceaf2866b&scope.project.id=23983865eb4e45aa9901bd8261331d42&role.id=2ba3b2926541436a9d26782420538af3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:38:16.691693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7e7c-04b0-4970-8caa-0d1fb52b3deb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:16.692213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7e7c-04b0-4970-8caa-0d1fb52b3deb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:16.692213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7e7c-04b0-4970-8caa-0d1fb52b3deb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:16.693503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 589/1162] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:16.698640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4804-ad57-46ce-b2e3-c10579467f12 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:16.699090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4804-ad57-46ce-b2e3-c10579467f12 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:16.699214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4804-ad57-46ce-b2e3-c10579467f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:16.717519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-79bd4804-ad57-46ce-b2e3-c10579467f12 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:16.718720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-79bd4804-ad57-46ce-b2e3-c10579467f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:16.775529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:16.784542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 574/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:16.806695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7e7c-04b0-4970-8caa-0d1fb52b3deb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:16.904456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7e7c-04b0-4970-8caa-0d1fb52b3deb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:16.926828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:16.938325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81f2a0-b25c-4c4d-9c76-d1b94c58c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:16.938956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81f2a0-b25c-4c4d-9c76-d1b94c58c69f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:16.939237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81f2a0-b25c-4c4d-9c76-d1b94c58c69f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:16.939508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81f2a0-b25c-4c4d-9c76-d1b94c58c69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:17.004154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81f2a0-b25c-4c4d-9c76-d1b94c58c69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:17.005518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81f2a0-b25c-4c4d-9c76-d1b94c58c69f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:17.100235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 590/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:38:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:38:17.106821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4804-ad57-46ce-b2e3-c10579467f12 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:17.201571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4804-ad57-46ce-b2e3-c10579467f12 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:17.235325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b86e29-2bab-4076-88a8-24e6bcceeaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:17.235961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86e29-2bab-4076-88a8-24e6bcceeaaa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:17.236241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86e29-2bab-4076-88a8-24e6bcceeaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:17.236510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86e29-2bab-4076-88a8-24e6bcceeaaa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:17.243076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b86e29-2bab-4076-88a8-24e6bcceeaaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:17.244508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b86e29-2bab-4076-88a8-24e6bcceeaaa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d4b86e29-2bab-4076-88a8-24e6bcceeaaa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:38:17.255895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:38:17.257222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:38:17.258383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 575/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:38:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:38:17.263577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81f2a0-b25c-4c4d-9c76-d1b94c58c69f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:17.287154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:17.360539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81f2a0-b25c-4c4d-9c76-d1b94c58c69f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:17.394133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927796d-82ca-4075-8282-e0daadb622d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:17.394732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927796d-82ca-4075-8282-e0daadb622d0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:17.395036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927796d-82ca-4075-8282-e0daadb622d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:17.395306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927796d-82ca-4075-8282-e0daadb622d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:17.395991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927796d-82ca-4075-8282-e0daadb622d0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:17.396288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927796d-82ca-4075-8282-e0daadb622d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:17.397646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927796d-82ca-4075-8282-e0daadb622d0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:17.405160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 591/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 27 07:38:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:19.395773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da937b-4831-42a3-a2a4-055ee7e882bb None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:19.396313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da937b-4831-42a3-a2a4-055ee7e882bb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:19.396313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da937b-4831-42a3-a2a4-055ee7e882bb None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:19.397639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 576/1167] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:19.403588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b85896-0f55-4536-bae0-f45d564fca49 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:19.404014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b85896-0f55-4536-bae0-f45d564fca49 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:19.404140 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b85896-0f55-4536-bae0-f45d564fca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:19.423934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b3b85896-0f55-4536-bae0-f45d564fca49 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:19.423934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b3b85896-0f55-4536-bae0-f45d564fca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:19.491132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 592/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:19.513535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da937b-4831-42a3-a2a4-055ee7e882bb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:19.568328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:19.613764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da937b-4831-42a3-a2a4-055ee7e882bb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:19.646779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2be8b9-4631-4de9-9364-af21c0ffe02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:19.647354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2be8b9-4631-4de9-9364-af21c0ffe02c None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:19.647633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2be8b9-4631-4de9-9364-af21c0ffe02c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:19.647904 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2be8b9-4631-4de9-9364-af21c0ffe02c None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:19.648607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2be8b9-4631-4de9-9364-af21c0ffe02c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:19.649955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2be8b9-4631-4de9-9364-af21c0ffe02c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:19.665969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 577/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Jul 27 07:38:19 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:38:21.696161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d393b9-4d2e-4ade-8c3a-ede5c11d761b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:21.696671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d393b9-4d2e-4ade-8c3a-ede5c11d761b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:21.696671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d393b9-4d2e-4ade-8c3a-ede5c11d761b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:21.697976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 593/1170] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:21.703549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84271-ca1d-469b-aa3f-54e35d06b9e8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:21.703974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84271-ca1d-469b-aa3f-54e35d06b9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:21.704109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84271-ca1d-469b-aa3f-54e35d06b9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:21.722691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-93d84271-ca1d-469b-aa3f-54e35d06b9e8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:21.723922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-93d84271-ca1d-469b-aa3f-54e35d06b9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:21.788781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 578/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:21.811624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d393b9-4d2e-4ade-8c3a-ede5c11d761b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:21.829668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:21.915703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d393b9-4d2e-4ade-8c3a-ede5c11d761b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:21.948404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86962379-834c-4225-97d6-d310b9ed94c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:21.949481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86962379-834c-4225-97d6-d310b9ed94c3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:21.949759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86962379-834c-4225-97d6-d310b9ed94c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:21.950030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86962379-834c-4225-97d6-d310b9ed94c3 None admin] PATH_INFO: `/v3/domains/04177e84ad324627b9dc1cc46e61ce5f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:21.960228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86962379-834c-4225-97d6-d310b9ed94c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=04177e84ad324627b9dc1cc46e61ce5f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:21.961673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86962379-834c-4225-97d6-d310b9ed94c3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:21.963323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 594/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Jul 27 07:38:21 2022] GET /identity/v3/domains/04177e84ad324627b9dc1cc46e61ce5f => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:21.970028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84271-ca1d-469b-aa3f-54e35d06b9e8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:22.015912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:22.068520 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84271-ca1d-469b-aa3f-54e35d06b9e8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:22.101718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936f3f1-f0b1-4124-af84-fb2ea4324f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:22.102445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936f3f1-f0b1-4124-af84-fb2ea4324f38 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:22.102822 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936f3f1-f0b1-4124-af84-fb2ea4324f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:22.103131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936f3f1-f0b1-4124-af84-fb2ea4324f38 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:22.103913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936f3f1-f0b1-4124-af84-fb2ea4324f38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:22.105685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936f3f1-f0b1-4124-af84-fb2ea4324f38 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:22.132307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 579/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:38:21 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:38:24.186738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd04c4-3e2f-4a33-976a-a6e178cdef33 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:24.187479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd04c4-3e2f-4a33-976a-a6e178cdef33 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:24.187479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd04c4-3e2f-4a33-976a-a6e178cdef33 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:24.188680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 595/1174] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:24.193936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02ab7-cd95-4c09-a2ee-4b83aec7caee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:24.194340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02ab7-cd95-4c09-a2ee-4b83aec7caee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:24.194481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02ab7-cd95-4c09-a2ee-4b83aec7caee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:24.214069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7eb02ab7-cd95-4c09-a2ee-4b83aec7caee None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:24.215980 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7eb02ab7-cd95-4c09-a2ee-4b83aec7caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:24.292860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 580/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:24.317243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd04c4-3e2f-4a33-976a-a6e178cdef33 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:24.395003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:24.418129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd04c4-3e2f-4a33-976a-a6e178cdef33 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:24.455745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabefc0-5fff-4a9c-83c9-58e32f7f0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:24.456303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabefc0-5fff-4a9c-83c9-58e32f7f0462 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:24.456581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabefc0-5fff-4a9c-83c9-58e32f7f0462 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:24.456852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabefc0-5fff-4a9c-83c9-58e32f7f0462 None admin] PATH_INFO: `/v3/domains/04177e84ad324627b9dc1cc46e61ce5f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:24.457998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabefc0-5fff-4a9c-83c9-58e32f7f0462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=04177e84ad324627b9dc1cc46e61ce5f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:24.459465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabefc0-5fff-4a9c-83c9-58e32f7f0462 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:24.461054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 596/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Jul 27 07:38:24 2022] GET /identity/v3/domains/04177e84ad324627b9dc1cc46e61ce5f => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:38:24.466979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb02ab7-cd95-4c09-a2ee-4b83aec7caee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:24.493185 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:24.566400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb02ab7-cd95-4c09-a2ee-4b83aec7caee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:24.600317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ada9b5-53a4-4654-ac92-9dea94a37d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:24.600931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ada9b5-53a4-4654-ac92-9dea94a37d36 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:24.601212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ada9b5-53a4-4654-ac92-9dea94a37d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:24.601483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ada9b5-53a4-4654-ac92-9dea94a37d36 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:24.602179 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ada9b5-53a4-4654-ac92-9dea94a37d36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:24.603667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ada9b5-53a4-4654-ac92-9dea94a37d36 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:24.625618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 581/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:38:24 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:38:26.637914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08842-b637-49bb-bd23-99f3e7e606e6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:26.638518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08842-b637-49bb-bd23-99f3e7e606e6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:26.638518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08842-b637-49bb-bd23-99f3e7e606e6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:26.639890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 597/1178] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:26.644999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9764f-665d-48a2-9608-3c2c79cf68cf None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:26.645433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9764f-665d-48a2-9608-3c2c79cf68cf None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:26.645542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9764f-665d-48a2-9608-3c2c79cf68cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:26.663618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-97f9764f-665d-48a2-9608-3c2c79cf68cf None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:26.664796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-97f9764f-665d-48a2-9608-3c2c79cf68cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:26.732054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 582/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:26.754407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08842-b637-49bb-bd23-99f3e7e606e6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:26.854174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08842-b637-49bb-bd23-99f3e7e606e6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:26.887870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4229ec-f967-450e-9b96-ae9cec77e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:26.888509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4229ec-f967-450e-9b96-ae9cec77e48a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:26.888784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4229ec-f967-450e-9b96-ae9cec77e48a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:26.889057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4229ec-f967-450e-9b96-ae9cec77e48a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:26.899710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4229ec-f967-450e-9b96-ae9cec77e48a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ee4229ec-f967-450e-9b96-ae9cec77e48a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:38:26.905196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:38:26.906309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:38:26.907601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 598/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:38:26.912432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9764f-665d-48a2-9608-3c2c79cf68cf None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:26.926396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:27.014781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9764f-665d-48a2-9608-3c2c79cf68cf None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:27.048025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ebc0-326f-45ea-891d-d9f8f84e18e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:27.048642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ebc0-326f-45ea-891d-d9f8f84e18e5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:27.048923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ebc0-326f-45ea-891d-d9f8f84e18e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:27.049194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ebc0-326f-45ea-891d-d9f8f84e18e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:27.049916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ebc0-326f-45ea-891d-d9f8f84e18e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:27.050218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ebc0-326f-45ea-891d-d9f8f84e18e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:27.051610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ebc0-326f-45ea-891d-d9f8f84e18e5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:27.059524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 583/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:27.065466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4229ec-f967-450e-9b96-ae9cec77e48a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:27.069741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:27.163547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4229ec-f967-450e-9b96-ae9cec77e48a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:27.195768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaf044-cb2b-4e6b-a5b6-67b523c16744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:27.196398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaf044-cb2b-4e6b-a5b6-67b523c16744 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:27.196676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaf044-cb2b-4e6b-a5b6-67b523c16744 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:27.196947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaf044-cb2b-4e6b-a5b6-67b523c16744 None admin] PATH_INFO: `/v3/users/92a3551912694d4185bc8ffb9a389246` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:27.210147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaf044-cb2b-4e6b-a5b6-67b523c16744 None admin] RBAC: Authorizing `identity:get_user(user_id=92a3551912694d4185bc8ffb9a389246)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:27.211875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaf044-cb2b-4e6b-a5b6-67b523c16744 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:27.213494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 599/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:38:27 2022] GET /identity/v3/users/92a3551912694d4185bc8ffb9a389246 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:27.222025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ebc0-326f-45ea-891d-d9f8f84e18e5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:27.294710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:27.319683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ebc0-326f-45ea-891d-d9f8f84e18e5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:27.361375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff243e0d-1519-4355-8540-e3a151dc0339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:27.361997 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff243e0d-1519-4355-8540-e3a151dc0339 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:27.362277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff243e0d-1519-4355-8540-e3a151dc0339 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:27.362549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff243e0d-1519-4355-8540-e3a151dc0339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:27.429602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff243e0d-1519-4355-8540-e3a151dc0339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:27.431097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff243e0d-1519-4355-8540-e3a151dc0339 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:27.502466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:27.527849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 584/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:38:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:38:27.533834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaf044-cb2b-4e6b-a5b6-67b523c16744 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:27.597202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:27.635839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaf044-cb2b-4e6b-a5b6-67b523c16744 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:27.670036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ca205-7b5c-4aec-b583-e0aab2800724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:27.670698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca205-7b5c-4aec-b583-e0aab2800724 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:27.670960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca205-7b5c-4aec-b583-e0aab2800724 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:27.671262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca205-7b5c-4aec-b583-e0aab2800724 None admin] PATH_INFO: `/v3/projects/6fe8669fea2d4c64a9a69e0ea48ca74a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:27.672417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca205-7b5c-4aec-b583-e0aab2800724 None admin] RBAC: Authorizing `identity:get_project(project_id=6fe8669fea2d4c64a9a69e0ea48ca74a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:27.673872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca205-7b5c-4aec-b583-e0aab2800724 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:27.675561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 600/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:38:27 2022] GET /identity/v3/projects/6fe8669fea2d4c64a9a69e0ea48ca74a => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:38:27.681697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff243e0d-1519-4355-8540-e3a151dc0339 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:27.777696 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff243e0d-1519-4355-8540-e3a151dc0339 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:27.811379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8b97-437b-43f4-a51e-23330384d98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:27.811987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8b97-437b-43f4-a51e-23330384d98f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:27.812265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8b97-437b-43f4-a51e-23330384d98f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:27.812536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8b97-437b-43f4-a51e-23330384d98f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:27.813409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8b97-437b-43f4-a51e-23330384d98f None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=6fe8669fea2d4c64a9a69e0ea48ca74a, user.id=92a3551912694d4185bc8ffb9a389246) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:27.813687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8b97-437b-43f4-a51e-23330384d98f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:27.815139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8b97-437b-43f4-a51e-23330384d98f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:27.820388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 585/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:38:27 2022] GET /identity/v3/role_assignments?user.id=92a3551912694d4185bc8ffb9a389246&scope.project.id=6fe8669fea2d4c64a9a69e0ea48ca74a&role.id=2ba3b2926541436a9d26782420538af3 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:29.789315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24fe4-7f81-4680-a296-409714a5e2d2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:29.789841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24fe4-7f81-4680-a296-409714a5e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:29.789841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24fe4-7f81-4680-a296-409714a5e2d2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:29.791151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 601/1186] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:29.796353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4fa4-3ab2-49ba-83ad-5fb076e111cb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:29.796776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4fa4-3ab2-49ba-83ad-5fb076e111cb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:29.796875 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4fa4-3ab2-49ba-83ad-5fb076e111cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:29.815095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a1cf4fa4-3ab2-49ba-83ad-5fb076e111cb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:29.816278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1cf4fa4-3ab2-49ba-83ad-5fb076e111cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:29.844972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:29.884776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 586/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:29.907342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24fe4-7f81-4680-a296-409714a5e2d2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:30.008429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24fe4-7f81-4680-a296-409714a5e2d2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:30.036009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:30.042900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d361247-d555-46b7-9d21-487ebcd6aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:30.043487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d361247-d555-46b7-9d21-487ebcd6aa39 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:30.043766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d361247-d555-46b7-9d21-487ebcd6aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:30.044037 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d361247-d555-46b7-9d21-487ebcd6aa39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:30.053963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d361247-d555-46b7-9d21-487ebcd6aa39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9d361247-d555-46b7-9d21-487ebcd6aa39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:38:30.059500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:38:30.060633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:38:30.061552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 602/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:38:30.066731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf4fa4-3ab2-49ba-83ad-5fb076e111cb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:30.162288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf4fa4-3ab2-49ba-83ad-5fb076e111cb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:30.195643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868830f-b8b4-440e-a684-ee3c9ba0a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:30.196257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868830f-b8b4-440e-a684-ee3c9ba0a9ac None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:30.196538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868830f-b8b4-440e-a684-ee3c9ba0a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:30.196806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868830f-b8b4-440e-a684-ee3c9ba0a9ac None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:30.197527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868830f-b8b4-440e-a684-ee3c9ba0a9ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:30.197831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868830f-b8b4-440e-a684-ee3c9ba0a9ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:30.199779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868830f-b8b4-440e-a684-ee3c9ba0a9ac None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:30.207618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 587/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:30.213578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d361247-d555-46b7-9d21-487ebcd6aa39 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:30.315069 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d361247-d555-46b7-9d21-487ebcd6aa39 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:30.348714 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d556-1df3-40e2-bdba-1eef98230216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:30.349336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d556-1df3-40e2-bdba-1eef98230216 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:30.349618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d556-1df3-40e2-bdba-1eef98230216 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:30.349884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d556-1df3-40e2-bdba-1eef98230216 None admin] PATH_INFO: `/v3/users/92a3551912694d4185bc8ffb9a389246` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:30.351059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398d556-1df3-40e2-bdba-1eef98230216 None admin] RBAC: Authorizing `identity:get_user(user_id=92a3551912694d4185bc8ffb9a389246)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:30.352483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398d556-1df3-40e2-bdba-1eef98230216 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:30.354073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 603/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:38:30 2022] GET /identity/v3/users/92a3551912694d4185bc8ffb9a389246 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:30.360579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868830f-b8b4-440e-a684-ee3c9ba0a9ac None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:30.390960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:30.459072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868830f-b8b4-440e-a684-ee3c9ba0a9ac None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:30.492903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc52840-f38a-47eb-90c3-0bcfe863a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:30.493574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc52840-f38a-47eb-90c3-0bcfe863a08a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:30.493856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc52840-f38a-47eb-90c3-0bcfe863a08a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:30.494129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc52840-f38a-47eb-90c3-0bcfe863a08a None admin] PATH_INFO: `/v3/projects/6fe8669fea2d4c64a9a69e0ea48ca74a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:30.495404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc52840-f38a-47eb-90c3-0bcfe863a08a None admin] RBAC: Authorizing `identity:get_project(project_id=6fe8669fea2d4c64a9a69e0ea48ca74a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:30.496840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc52840-f38a-47eb-90c3-0bcfe863a08a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:30.498494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 588/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:38:30 2022] GET /identity/v3/projects/6fe8669fea2d4c64a9a69e0ea48ca74a => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:30.504446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d556-1df3-40e2-bdba-1eef98230216 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:30.562671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:30.604775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398d556-1df3-40e2-bdba-1eef98230216 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:30.637154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cf8c1-e6ab-46af-b8d8-933b63e4050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:30.638433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cf8c1-e6ab-46af-b8d8-933b63e4050a None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:30.638711 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cf8c1-e6ab-46af-b8d8-933b63e4050a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:30.639017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cf8c1-e6ab-46af-b8d8-933b63e4050a None admin] PATH_INFO: `/v3/projects/6fe8669fea2d4c64a9a69e0ea48ca74a/users/92a3551912694d4185bc8ffb9a389246/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:30.640937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cf8c1-e6ab-46af-b8d8-933b63e4050a None admin] RBAC: Authorizing `identity:create_grant(project_id=6fe8669fea2d4c64a9a69e0ea48ca74a, user_id=92a3551912694d4185bc8ffb9a389246, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:30.642372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cf8c1-e6ab-46af-b8d8-933b63e4050a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:30.655361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 604/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:38:30 2022] PUT /identity/v3/projects/6fe8669fea2d4c64a9a69e0ea48ca74a/users/92a3551912694d4185bc8ffb9a389246/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:38:32.646176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6159f-8f4d-4c4f-a118-d56d9a1dbda2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:32.646720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6159f-8f4d-4c4f-a118-d56d9a1dbda2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:32.646720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6159f-8f4d-4c4f-a118-d56d9a1dbda2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:32.648112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 589/1193] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:38:32.653730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a74b-5603-4b4b-82f5-60902c09687f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:32.654159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a74b-5603-4b4b-82f5-60902c09687f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:32.654280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a74b-5603-4b4b-82f5-60902c09687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:32.672384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-aa69a74b-5603-4b4b-82f5-60902c09687f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:38:32.673549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-aa69a74b-5603-4b4b-82f5-60902c09687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:38:32.740921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 605/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:38:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:38:32.763907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6159f-8f4d-4c4f-a118-d56d9a1dbda2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:32.861394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:32.866709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6159f-8f4d-4c4f-a118-d56d9a1dbda2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:32.902129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106e25c-73b2-487b-88ae-326545df1f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:32.903397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106e25c-73b2-487b-88ae-326545df1f78 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:32.903689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106e25c-73b2-487b-88ae-326545df1f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:32.903963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106e25c-73b2-487b-88ae-326545df1f78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:32.914407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106e25c-73b2-487b-88ae-326545df1f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8106e25c-73b2-487b-88ae-326545df1f78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:38:32.919314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:38:32.920401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:38:32.921445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 590/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:38:32.926608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69a74b-5603-4b4b-82f5-60902c09687f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:32.975432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:33.025657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69a74b-5603-4b4b-82f5-60902c09687f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:33.061122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404438e8-b571-4469-9360-bcd87cbd13c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:33.061735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404438e8-b571-4469-9360-bcd87cbd13c0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:33.062015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404438e8-b571-4469-9360-bcd87cbd13c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:33.062287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404438e8-b571-4469-9360-bcd87cbd13c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:33.063055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404438e8-b571-4469-9360-bcd87cbd13c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:33.063345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404438e8-b571-4469-9360-bcd87cbd13c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:33.064713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404438e8-b571-4469-9360-bcd87cbd13c0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:33.072587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 606/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:38:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:33.078873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106e25c-73b2-487b-88ae-326545df1f78 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:33.175739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106e25c-73b2-487b-88ae-326545df1f78 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:33.208350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51ea2-d3af-49e4-8e6c-05ca27b5c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:33.208978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51ea2-d3af-49e4-8e6c-05ca27b5c2dd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:33.209252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51ea2-d3af-49e4-8e6c-05ca27b5c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:33.209518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51ea2-d3af-49e4-8e6c-05ca27b5c2dd None admin] PATH_INFO: `/v3/users/92a3551912694d4185bc8ffb9a389246` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:33.210725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d51ea2-d3af-49e4-8e6c-05ca27b5c2dd None admin] RBAC: Authorizing `identity:get_user(user_id=92a3551912694d4185bc8ffb9a389246)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:33.212174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d51ea2-d3af-49e4-8e6c-05ca27b5c2dd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:33.213745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 591/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 27 07:38:33 2022] GET /identity/v3/users/92a3551912694d4185bc8ffb9a389246 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:33.219605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404438e8-b571-4469-9360-bcd87cbd13c0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:33.317412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404438e8-b571-4469-9360-bcd87cbd13c0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:33.328017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:33.351343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628e5ff-2de0-446e-a557-bb258db4efad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:33.351952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628e5ff-2de0-446e-a557-bb258db4efad None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:33.352237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628e5ff-2de0-446e-a557-bb258db4efad None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:33.352508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628e5ff-2de0-446e-a557-bb258db4efad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:33.417692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628e5ff-2de0-446e-a557-bb258db4efad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:33.419228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628e5ff-2de0-446e-a557-bb258db4efad None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:33.515240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 607/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:38:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 07:38:33.521252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51ea2-d3af-49e4-8e6c-05ca27b5c2dd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:33.548585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:33.618567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51ea2-d3af-49e4-8e6c-05ca27b5c2dd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:33.651376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdd7bf-585c-4fa0-8136-3700cb26726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:33.652011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdd7bf-585c-4fa0-8136-3700cb26726f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:33.652292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdd7bf-585c-4fa0-8136-3700cb26726f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:33.652565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdd7bf-585c-4fa0-8136-3700cb26726f None admin] PATH_INFO: `/v3/projects/6fe8669fea2d4c64a9a69e0ea48ca74a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:33.653728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdd7bf-585c-4fa0-8136-3700cb26726f None admin] RBAC: Authorizing `identity:get_project(project_id=6fe8669fea2d4c64a9a69e0ea48ca74a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:33.655180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdd7bf-585c-4fa0-8136-3700cb26726f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:33.656831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 592/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 27 07:38:33 2022] GET /identity/v3/projects/6fe8669fea2d4c64a9a69e0ea48ca74a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:33.662978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628e5ff-2de0-446e-a557-bb258db4efad None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:38:33.674932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:33.763053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628e5ff-2de0-446e-a557-bb258db4efad None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:38:33.796282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f7aef-ee30-42f0-aa48-76664ffa82bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:38:33.796891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7aef-ee30-42f0-aa48-76664ffa82bf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:38:33.797172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7aef-ee30-42f0-aa48-76664ffa82bf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:38:33.797447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7aef-ee30-42f0-aa48-76664ffa82bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:38:33.798231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f7aef-ee30-42f0-aa48-76664ffa82bf None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=6fe8669fea2d4c64a9a69e0ea48ca74a, user.id=92a3551912694d4185bc8ffb9a389246) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:38:33.798541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f7aef-ee30-42f0-aa48-76664ffa82bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:38:33.800014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f7aef-ee30-42f0-aa48-76664ffa82bf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:38:33.805838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 608/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:38:33 2022] GET /identity/v3/role_assignments?user.id=92a3551912694d4185bc8ffb9a389246&scope.project.id=6fe8669fea2d4c64a9a69e0ea48ca74a&role.id=2ba3b2926541436a9d26782420538af3 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:38:43.647223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=53 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:38:43.803271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=63 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:29.458362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d497d-16ff-4597-a1f2-d691151ee0b5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:29.459200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d497d-16ff-4597-a1f2-d691151ee0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:29.459200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d497d-16ff-4597-a1f2-d691151ee0b5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:29.460634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 593/1201] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:39:29.468368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57944fc7-170a-4100-91fd-4057b2789792 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:29.468954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57944fc7-170a-4100-91fd-4057b2789792 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:29.468954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57944fc7-170a-4100-91fd-4057b2789792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:29.487760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-57944fc7-170a-4100-91fd-4057b2789792 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:39:29.489036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-57944fc7-170a-4100-91fd-4057b2789792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:39:29.581696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 609/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:39:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:39:29.609178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d497d-16ff-4597-a1f2-d691151ee0b5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:29.758390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d497d-16ff-4597-a1f2-d691151ee0b5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:29.813729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31607bc-bf36-4482-b209-46d38690a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:29.814398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31607bc-bf36-4482-b209-46d38690a341 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:29.814670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31607bc-bf36-4482-b209-46d38690a341 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:29.815056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31607bc-bf36-4482-b209-46d38690a341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:29.833945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31607bc-bf36-4482-b209-46d38690a341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:29.833945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31607bc-bf36-4482-b209-46d38690a341 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d31607bc-bf36-4482-b209-46d38690a341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:29.851781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:29.852900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:29.854406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:29.854406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:29.854406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:29.854406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:29.854406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 594/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:39:29.861307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57944fc7-170a-4100-91fd-4057b2789792 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:30.006371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57944fc7-170a-4100-91fd-4057b2789792 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:30.054564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:30.061685 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ba25-7d16-475c-a75f-2a29c022db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:30.062327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ba25-7d16-475c-a75f-2a29c022db87 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:30.062680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ba25-7d16-475c-a75f-2a29c022db87 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:30.062933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ba25-7d16-475c-a75f-2a29c022db87 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:30.063626 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1ba25-7d16-475c-a75f-2a29c022db87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:30.063932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1ba25-7d16-475c-a75f-2a29c022db87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:30.065484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1ba25-7d16-475c-a75f-2a29c022db87 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:30.083219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 610/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:30.086775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31607bc-bf36-4482-b209-46d38690a341 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:30.168436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:30.229904 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31607bc-bf36-4482-b209-46d38690a341 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:30.269982 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f04d5-3dc0-4d3e-870c-3ecec6cce749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:30.270615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f04d5-3dc0-4d3e-870c-3ecec6cce749 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:30.271029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f04d5-3dc0-4d3e-870c-3ecec6cce749 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:30.271329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f04d5-3dc0-4d3e-870c-3ecec6cce749 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:30.271970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f04d5-3dc0-4d3e-870c-3ecec6cce749 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:30.273492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f04d5-3dc0-4d3e-870c-3ecec6cce749 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:30.303989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 595/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 27 07:39:30 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:39:32.649806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16e5d1-8fe0-4baa-b177-4454a523bd58 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:32.649806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16e5d1-8fe0-4baa-b177-4454a523bd58 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:32.649806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16e5d1-8fe0-4baa-b177-4454a523bd58 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:32.649806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 611/1206] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:39:32.655871 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba666d3-4a3d-48eb-8c0a-be8b76a9baed None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:32.656311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba666d3-4a3d-48eb-8c0a-be8b76a9baed None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:32.656501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba666d3-4a3d-48eb-8c0a-be8b76a9baed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:32.676940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9ba666d3-4a3d-48eb-8c0a-be8b76a9baed None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:39:32.678117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9ba666d3-4a3d-48eb-8c0a-be8b76a9baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:39:32.755376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 596/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:39:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:39:32.780754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16e5d1-8fe0-4baa-b177-4454a523bd58 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:32.929097 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16e5d1-8fe0-4baa-b177-4454a523bd58 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:32.979058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63e56b-40c2-409e-a440-5db46d32e456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:32.980281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e56b-40c2-409e-a440-5db46d32e456 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:32.980716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e56b-40c2-409e-a440-5db46d32e456 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:32.981005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e56b-40c2-409e-a440-5db46d32e456 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:32.994709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63e56b-40c2-409e-a440-5db46d32e456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-af63e56b-40c2-409e-a440-5db46d32e456 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:39:33.000696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:33.001736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:39:33.002588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:33.011225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 612/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:33.013603 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba666d3-4a3d-48eb-8c0a-be8b76a9baed None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:33.072486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:33.150672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba666d3-4a3d-48eb-8c0a-be8b76a9baed None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:33.192311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cc9f9-276d-4e3e-b0bd-fabf9ecb3c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:33.193330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cc9f9-276d-4e3e-b0bd-fabf9ecb3c4b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:33.193644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cc9f9-276d-4e3e-b0bd-fabf9ecb3c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:33.193883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cc9f9-276d-4e3e-b0bd-fabf9ecb3c4b None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:33.194614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cc9f9-276d-4e3e-b0bd-fabf9ecb3c4b None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:33.194944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cc9f9-276d-4e3e-b0bd-fabf9ecb3c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:33.196330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cc9f9-276d-4e3e-b0bd-fabf9ecb3c4b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:33.206047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 597/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:33.212250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63e56b-40c2-409e-a440-5db46d32e456 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:33.277857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:33.338767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63e56b-40c2-409e-a440-5db46d32e456 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:33.378301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dda53-8782-4ae4-a208-ddac5352996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:33.378989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dda53-8782-4ae4-a208-ddac5352996f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:33.379271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dda53-8782-4ae4-a208-ddac5352996f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:33.379543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dda53-8782-4ae4-a208-ddac5352996f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:33.393171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dda53-8782-4ae4-a208-ddac5352996f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:33.394698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dda53-8782-4ae4-a208-ddac5352996f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-573dda53-8782-4ae4-a208-ddac5352996f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:33.418390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:33.420116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:33.421036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:33.421036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:33.421036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:33.421036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:33.421036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 613/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:33.427418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cc9f9-276d-4e3e-b0bd-fabf9ecb3c4b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:33.551715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:33.554670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cc9f9-276d-4e3e-b0bd-fabf9ecb3c4b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:33.595205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81034228-5087-465a-89f4-bc7df27259d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:33.596088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81034228-5087-465a-89f4-bc7df27259d5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:33.596368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81034228-5087-465a-89f4-bc7df27259d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:33.596639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81034228-5087-465a-89f4-bc7df27259d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:33.597336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81034228-5087-465a-89f4-bc7df27259d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:33.597726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81034228-5087-465a-89f4-bc7df27259d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:33.599150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81034228-5087-465a-89f4-bc7df27259d5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:33.613151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 598/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:33.621312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dda53-8782-4ae4-a208-ddac5352996f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:33.746630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dda53-8782-4ae4-a208-ddac5352996f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:33.750200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:33.788708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13b50d-122a-4bf7-9f2e-4cf23198b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:33.789360 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13b50d-122a-4bf7-9f2e-4cf23198b0ee None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:33.789639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13b50d-122a-4bf7-9f2e-4cf23198b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:33.789913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13b50d-122a-4bf7-9f2e-4cf23198b0ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:33.798757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13b50d-122a-4bf7-9f2e-4cf23198b0ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:33.800253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13b50d-122a-4bf7-9f2e-4cf23198b0ee None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ef13b50d-122a-4bf7-9f2e-4cf23198b0ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:39:33.813999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:33.815152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:33.816687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 614/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:33.822291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81034228-5087-465a-89f4-bc7df27259d5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:33.945933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81034228-5087-465a-89f4-bc7df27259d5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:33.990802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde027-e28c-47c5-a84e-244cf0f0e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:33.991530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde027-e28c-47c5-a84e-244cf0f0e343 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:33.991804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde027-e28c-47c5-a84e-244cf0f0e343 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:33.992093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde027-e28c-47c5-a84e-244cf0f0e343 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:33.992898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde027-e28c-47c5-a84e-244cf0f0e343 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:33.993203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde027-e28c-47c5-a84e-244cf0f0e343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:33.995190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde027-e28c-47c5-a84e-244cf0f0e343 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:34.018187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 599/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 27 07:39:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:34.023895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13b50d-122a-4bf7-9f2e-4cf23198b0ee None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:34.146067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13b50d-122a-4bf7-9f2e-4cf23198b0ee None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:34.189083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881041c-e325-407d-8c51-ee91c8362348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:34.189925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881041c-e325-407d-8c51-ee91c8362348 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:34.190417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881041c-e325-407d-8c51-ee91c8362348 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:34.190827 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881041c-e325-407d-8c51-ee91c8362348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:34.232032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:34.274837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881041c-e325-407d-8c51-ee91c8362348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:34.276505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881041c-e325-407d-8c51-ee91c8362348 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:34.401853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 615/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:39:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:39:34.403232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde027-e28c-47c5-a84e-244cf0f0e343 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:34.431377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:34.527224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde027-e28c-47c5-a84e-244cf0f0e343 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:34.562707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9775a-cb76-4409-88d8-3523a690b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:34.563384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9775a-cb76-4409-88d8-3523a690b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:34.563750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9775a-cb76-4409-88d8-3523a690b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:34.564028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9775a-cb76-4409-88d8-3523a690b0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:34.578137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9775a-cb76-4409-88d8-3523a690b0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:34.579669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9775a-cb76-4409-88d8-3523a690b0b9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-58d9775a-cb76-4409-88d8-3523a690b0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:34.598311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:34.600735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:34.601869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:34.601869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:34.601869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:34.601869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:34.601869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 600/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:39:34.606926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881041c-e325-407d-8c51-ee91c8362348 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:34.690981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:34.735623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881041c-e325-407d-8c51-ee91c8362348 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:34.775092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dca902-8f47-4ed6-b0de-858de3c0401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:34.775899 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dca902-8f47-4ed6-b0de-858de3c0401f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:34.776105 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dca902-8f47-4ed6-b0de-858de3c0401f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:34.776337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dca902-8f47-4ed6-b0de-858de3c0401f None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:34.777144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dca902-8f47-4ed6-b0de-858de3c0401f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:34.777490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dca902-8f47-4ed6-b0de-858de3c0401f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:34.779029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dca902-8f47-4ed6-b0de-858de3c0401f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:34.791903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 616/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:34.798450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9775a-cb76-4409-88d8-3523a690b0b9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:34.875328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:34.921022 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9775a-cb76-4409-88d8-3523a690b0b9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:34.961774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dcdb2-7b37-42e0-b96d-6852fd489319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:34.962442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dcdb2-7b37-42e0-b96d-6852fd489319 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:34.962686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dcdb2-7b37-42e0-b96d-6852fd489319 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:34.963049 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dcdb2-7b37-42e0-b96d-6852fd489319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:34.973233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dcdb2-7b37-42e0-b96d-6852fd489319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:34.975093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dcdb2-7b37-42e0-b96d-6852fd489319 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-df3dcdb2-7b37-42e0-b96d-6852fd489319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:39:34.988458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:34.989631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:34.990571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:39:34.990571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:39:34.990571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:39:34.990571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:39:34.990571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:39:34.990571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:39:34.990571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:34.990571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:34.990571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 601/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:34.997763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dca902-8f47-4ed6-b0de-858de3c0401f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:35.129199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dca902-8f47-4ed6-b0de-858de3c0401f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:35.158767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:35.173522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc00f7-19d0-497f-b921-82a535d57761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:35.174171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc00f7-19d0-497f-b921-82a535d57761 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:35.174463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc00f7-19d0-497f-b921-82a535d57761 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:35.174739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc00f7-19d0-497f-b921-82a535d57761 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:35.175522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc00f7-19d0-497f-b921-82a535d57761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:35.175832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc00f7-19d0-497f-b921-82a535d57761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:35.177280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc00f7-19d0-497f-b921-82a535d57761 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:35.190321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 617/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:35.197177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dcdb2-7b37-42e0-b96d-6852fd489319 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:35.319422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dcdb2-7b37-42e0-b96d-6852fd489319 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:35.357883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:35.364834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7e9e3-49ea-49a6-947c-6d614f3c2106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:35.365524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7e9e3-49ea-49a6-947c-6d614f3c2106 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:35.365874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7e9e3-49ea-49a6-947c-6d614f3c2106 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:35.366202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7e9e3-49ea-49a6-947c-6d614f3c2106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:35.367092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7e9e3-49ea-49a6-947c-6d614f3c2106 None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=beaec3b392e3468981992629101cf883) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:35.367471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7e9e3-49ea-49a6-947c-6d614f3c2106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:35.368989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7e9e3-49ea-49a6-947c-6d614f3c2106 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:35.374830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 602/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:39:35 2022] GET /identity/v3/role_assignments?user.id=beaec3b392e3468981992629101cf883&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:37.461187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf8257-493d-42f5-a7a6-a25c7c581ccd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:37.461750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf8257-493d-42f5-a7a6-a25c7c581ccd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:37.461750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf8257-493d-42f5-a7a6-a25c7c581ccd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:37.463695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 618/1220] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:39:37.468998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e9e3-6518-410f-9d7c-09f9f3635580 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:37.469444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e9e3-6518-410f-9d7c-09f9f3635580 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:37.469551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e9e3-6518-410f-9d7c-09f9f3635580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:37.490320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-18c9e9e3-6518-410f-9d7c-09f9f3635580 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:39:37.491859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-18c9e9e3-6518-410f-9d7c-09f9f3635580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:39:37.564519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 603/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:39:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:39:37.589088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf8257-493d-42f5-a7a6-a25c7c581ccd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:37.695339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf8257-493d-42f5-a7a6-a25c7c581ccd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:37.732107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94704910-1b21-4d16-a0a7-958ac099d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:37.732837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94704910-1b21-4d16-a0a7-958ac099d2bb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:37.733023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94704910-1b21-4d16-a0a7-958ac099d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:37.733294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94704910-1b21-4d16-a0a7-958ac099d2bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:37.744330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94704910-1b21-4d16-a0a7-958ac099d2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-94704910-1b21-4d16-a0a7-958ac099d2bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:39:37.749165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:37.750280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:37.751323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 619/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:39:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:37.756431 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9e9e3-6518-410f-9d7c-09f9f3635580 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:37.863547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9e9e3-6518-410f-9d7c-09f9f3635580 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:37.889572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:37.905128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6abbe3-c4eb-4814-85ae-0684e7571ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:37.905762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6abbe3-c4eb-4814-85ae-0684e7571ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:37.906052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6abbe3-c4eb-4814-85ae-0684e7571ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:37.906364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6abbe3-c4eb-4814-85ae-0684e7571ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:37.907133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6abbe3-c4eb-4814-85ae-0684e7571ad6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:37.907450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6abbe3-c4eb-4814-85ae-0684e7571ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:37.908908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6abbe3-c4eb-4814-85ae-0684e7571ad6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:37.918142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 604/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:39:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:37.927343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94704910-1b21-4d16-a0a7-958ac099d2bb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:37.972964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:38.035830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94704910-1b21-4d16-a0a7-958ac099d2bb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:38.082583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fa895-b64a-455b-91c2-4e19f77fe1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:38.083252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fa895-b64a-455b-91c2-4e19f77fe1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:38.083527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fa895-b64a-455b-91c2-4e19f77fe1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:38.083794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fa895-b64a-455b-91c2-4e19f77fe1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:38.093760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fa895-b64a-455b-91c2-4e19f77fe1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:38.095238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fa895-b64a-455b-91c2-4e19f77fe1b5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ba1fa895-b64a-455b-91c2-4e19f77fe1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:38.111466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:38.112582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:38.113504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:38.113504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:38.113504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:38.113504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:38.113504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 620/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:38.119993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6abbe3-c4eb-4814-85ae-0684e7571ad6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:38.252003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6abbe3-c4eb-4814-85ae-0684e7571ad6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:38.289580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7f53-e25d-491a-9c8b-e0c758d2c247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:38.290719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7f53-e25d-491a-9c8b-e0c758d2c247 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:38.291097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7f53-e25d-491a-9c8b-e0c758d2c247 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:38.291455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7f53-e25d-491a-9c8b-e0c758d2c247 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:38.292230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec7f53-e25d-491a-9c8b-e0c758d2c247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:38.292539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec7f53-e25d-491a-9c8b-e0c758d2c247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:38.293993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec7f53-e25d-491a-9c8b-e0c758d2c247 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:38.308119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 605/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:38.314632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fa895-b64a-455b-91c2-4e19f77fe1b5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:38.425559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:38.435183 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fa895-b64a-455b-91c2-4e19f77fe1b5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:38.476007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833c383-8c15-4fb5-b0fc-0dd2b4dabc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:38.476797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c383-8c15-4fb5-b0fc-0dd2b4dabc57 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:38.476902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c383-8c15-4fb5-b0fc-0dd2b4dabc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:38.477284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c383-8c15-4fb5-b0fc-0dd2b4dabc57 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:38.486695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833c383-8c15-4fb5-b0fc-0dd2b4dabc57 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:38.488382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833c383-8c15-4fb5-b0fc-0dd2b4dabc57 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7833c383-8c15-4fb5-b0fc-0dd2b4dabc57 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:39:38.500741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:38.501866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:38.503118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 621/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:39:38.508775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7f53-e25d-491a-9c8b-e0c758d2c247 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:38.561660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:38.624361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7f53-e25d-491a-9c8b-e0c758d2c247 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:38.661629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538592-42b6-48bb-8997-b10296a948d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:38.662258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538592-42b6-48bb-8997-b10296a948d1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:38.662543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538592-42b6-48bb-8997-b10296a948d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:38.662810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538592-42b6-48bb-8997-b10296a948d1 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:38.663652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78538592-42b6-48bb-8997-b10296a948d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:38.663964 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78538592-42b6-48bb-8997-b10296a948d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:38.665937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78538592-42b6-48bb-8997-b10296a948d1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:38.684333 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 606/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 27 07:39:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:38.690734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833c383-8c15-4fb5-b0fc-0dd2b4dabc57 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:38.803297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833c383-8c15-4fb5-b0fc-0dd2b4dabc57 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:38.851941 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beff093-2e92-4ab4-8934-23d4c4817386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:38.852581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beff093-2e92-4ab4-8934-23d4c4817386 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:38.852888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beff093-2e92-4ab4-8934-23d4c4817386 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:38.853159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beff093-2e92-4ab4-8934-23d4c4817386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:38.865217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beff093-2e92-4ab4-8934-23d4c4817386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:38.866713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beff093-2e92-4ab4-8934-23d4c4817386 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1beff093-2e92-4ab4-8934-23d4c4817386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:38.882342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:38.883572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:38.885024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:38.885024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:38.885024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:38.885024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:38.885024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 622/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:38.891001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538592-42b6-48bb-8997-b10296a948d1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:39.003798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538592-42b6-48bb-8997-b10296a948d1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:39.006575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:39.044173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8183f16-0421-4a49-a2e9-68fe9834fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:39.044939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8183f16-0421-4a49-a2e9-68fe9834fb3e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:39.045313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8183f16-0421-4a49-a2e9-68fe9834fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:39.045636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8183f16-0421-4a49-a2e9-68fe9834fb3e None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:39.046499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8183f16-0421-4a49-a2e9-68fe9834fb3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:39.046842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8183f16-0421-4a49-a2e9-68fe9834fb3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:39.048637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8183f16-0421-4a49-a2e9-68fe9834fb3e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:39.067097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 607/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:39.074006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beff093-2e92-4ab4-8934-23d4c4817386 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:39.084678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:39.191938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beff093-2e92-4ab4-8934-23d4c4817386 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:39.230283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b2f5d-aeb5-4c7f-a2af-d1ba5fbf72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:39.230995 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b2f5d-aeb5-4c7f-a2af-d1ba5fbf72f7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:39.231274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b2f5d-aeb5-4c7f-a2af-d1ba5fbf72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:39.231544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b2f5d-aeb5-4c7f-a2af-d1ba5fbf72f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:39.238754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b2f5d-aeb5-4c7f-a2af-d1ba5fbf72f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:39.240349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b2f5d-aeb5-4c7f-a2af-d1ba5fbf72f7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-eb3b2f5d-aeb5-4c7f-a2af-d1ba5fbf72f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:39:39.252604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:39.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:39.254911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:39:39.254911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:39:39.254911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:39:39.254911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:39:39.254911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:39:39.254911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:39:39.254911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:39.254911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:39.254911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 623/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:39:39.259731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8183f16-0421-4a49-a2e9-68fe9834fb3e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:39.381385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8183f16-0421-4a49-a2e9-68fe9834fb3e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:39.424520 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3648d6-ea4d-421f-baf4-8b59af4891c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:39.425163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3648d6-ea4d-421f-baf4-8b59af4891c8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:39.425430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3648d6-ea4d-421f-baf4-8b59af4891c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:39.425701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3648d6-ea4d-421f-baf4-8b59af4891c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:39.426476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3648d6-ea4d-421f-baf4-8b59af4891c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:39.427343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3648d6-ea4d-421f-baf4-8b59af4891c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:39.428789 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3648d6-ea4d-421f-baf4-8b59af4891c8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:39.443582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 608/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:39.450041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b2f5d-aeb5-4c7f-a2af-d1ba5fbf72f7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:39.522583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:39.564375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b2f5d-aeb5-4c7f-a2af-d1ba5fbf72f7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:39.602271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f431121-c56b-4b01-bebf-acd65231bd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:39.603103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431121-c56b-4b01-bebf-acd65231bd09 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:39.603429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431121-c56b-4b01-bebf-acd65231bd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:39.603706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431121-c56b-4b01-bebf-acd65231bd09 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/beaec3b392e3468981992629101cf883/roles/acd4741d776c40b8b1f5563ad208b994` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:39.619180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f431121-c56b-4b01-bebf-acd65231bd09 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=beaec3b392e3468981992629101cf883, role_id=acd4741d776c40b8b1f5563ad208b994)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:39.620800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f431121-c56b-4b01-bebf-acd65231bd09 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:39.634573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 624/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:39:39 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/beaec3b392e3468981992629101cf883/roles/acd4741d776c40b8b1f5563ad208b994 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:39:41.863413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92769-ea4f-4ffe-8e0b-d536f54abbb7 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:41.864030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92769-ea4f-4ffe-8e0b-d536f54abbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:41.864220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92769-ea4f-4ffe-8e0b-d536f54abbb7 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:41.865985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 609/1233] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:39:41.872571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fd352-3fe8-49a8-85e6-0ed3c259cd54 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:41.873046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fd352-3fe8-49a8-85e6-0ed3c259cd54 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:41.873145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fd352-3fe8-49a8-85e6-0ed3c259cd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:41.896545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9e4fd352-3fe8-49a8-85e6-0ed3c259cd54 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:39:41.897812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9e4fd352-3fe8-49a8-85e6-0ed3c259cd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:39:41.979798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 625/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:39:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:39:42.002910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92769-ea4f-4ffe-8e0b-d536f54abbb7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:42.032372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:42.122610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92769-ea4f-4ffe-8e0b-d536f54abbb7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:42.171331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b2972-847e-4325-8d3d-47e6c5fab502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:42.172060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b2972-847e-4325-8d3d-47e6c5fab502 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:42.172366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b2972-847e-4325-8d3d-47e6c5fab502 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:42.172656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b2972-847e-4325-8d3d-47e6c5fab502 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:42.184529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b2972-847e-4325-8d3d-47e6c5fab502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-7f3b2972-847e-4325-8d3d-47e6c5fab502 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:39:42.189978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:42.191266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:42.192320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 610/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 27 07:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:42.198079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fd352-3fe8-49a8-85e6-0ed3c259cd54 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:42.250798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:42.310007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fd352-3fe8-49a8-85e6-0ed3c259cd54 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:42.350324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead41e-0284-411e-8fe4-0b1e86602acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:42.351190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead41e-0284-411e-8fe4-0b1e86602acc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:42.351472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead41e-0284-411e-8fe4-0b1e86602acc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:42.351739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead41e-0284-411e-8fe4-0b1e86602acc None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:42.352641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ead41e-0284-411e-8fe4-0b1e86602acc None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:42.353044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ead41e-0284-411e-8fe4-0b1e86602acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:42.354478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ead41e-0284-411e-8fe4-0b1e86602acc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:42.364671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 626/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 27 07:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:42.371360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b2972-847e-4325-8d3d-47e6c5fab502 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:42.476240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:42.496120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b2972-847e-4325-8d3d-47e6c5fab502 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:42.532802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92a7e-0229-455a-8036-dab3c8a195e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:42.533450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92a7e-0229-455a-8036-dab3c8a195e4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:42.533731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92a7e-0229-455a-8036-dab3c8a195e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:42.534004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92a7e-0229-455a-8036-dab3c8a195e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:42.544922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d92a7e-0229-455a-8036-dab3c8a195e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:42.546354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d92a7e-0229-455a-8036-dab3c8a195e4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-52d92a7e-0229-455a-8036-dab3c8a195e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:42.561965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:42.563150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:42.564323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:42.564323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:42.564323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:42.564323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:42.564323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 611/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:42.569004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead41e-0284-411e-8fe4-0b1e86602acc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:42.683350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead41e-0284-411e-8fe4-0b1e86602acc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:42.693091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:42.723348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0e0e0-78d6-41b0-b2e0-6361d9a3e798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:42.724016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0e0e0-78d6-41b0-b2e0-6361d9a3e798 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:42.724403 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0e0e0-78d6-41b0-b2e0-6361d9a3e798 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:42.724683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0e0e0-78d6-41b0-b2e0-6361d9a3e798 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:42.725544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0e0e0-78d6-41b0-b2e0-6361d9a3e798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:42.725922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0e0e0-78d6-41b0-b2e0-6361d9a3e798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:42.727568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0e0e0-78d6-41b0-b2e0-6361d9a3e798 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:42.740005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 627/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:42.746355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92a7e-0229-455a-8036-dab3c8a195e4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:42.867569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92a7e-0229-455a-8036-dab3c8a195e4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:42.907967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1fdce-562f-4e8d-846f-e1306be565ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:42.908949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1fdce-562f-4e8d-846f-e1306be565ad None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:42.909384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1fdce-562f-4e8d-846f-e1306be565ad None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:42.909697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1fdce-562f-4e8d-846f-e1306be565ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:42.912878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:42.921398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1fdce-562f-4e8d-846f-e1306be565ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:42.923232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1fdce-562f-4e8d-846f-e1306be565ad None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-83e1fdce-562f-4e8d-846f-e1306be565ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:39:42.938624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:42.939851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:42.940820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 612/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:42.946341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0e0e0-78d6-41b0-b2e0-6361d9a3e798 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:43.065661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0e0e0-78d6-41b0-b2e0-6361d9a3e798 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:43.104975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7344029-e781-4220-876e-04f962737803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:43.105712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344029-e781-4220-876e-04f962737803 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:43.106029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344029-e781-4220-876e-04f962737803 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:43.106425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344029-e781-4220-876e-04f962737803 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:43.107310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7344029-e781-4220-876e-04f962737803 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:43.107766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7344029-e781-4220-876e-04f962737803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:43.109359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7344029-e781-4220-876e-04f962737803 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:43.133626 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 628/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 27 07:39:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:43.141755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1fdce-562f-4e8d-846f-e1306be565ad None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:43.253771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1fdce-562f-4e8d-846f-e1306be565ad None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:43.292127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357264-f368-4c45-99ef-657edffd0700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:43.293038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357264-f368-4c45-99ef-657edffd0700 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:43.293373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357264-f368-4c45-99ef-657edffd0700 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:43.293754 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357264-f368-4c45-99ef-657edffd0700 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:43.365286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:43.374061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe357264-f368-4c45-99ef-657edffd0700 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:43.375652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe357264-f368-4c45-99ef-657edffd0700 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:43.496953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 613/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:39:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:39:43.505581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7344029-e781-4220-876e-04f962737803 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:43.535033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:43.621227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7344029-e781-4220-876e-04f962737803 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:43.657100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600c59f-e1aa-453e-938a-025c9dc2a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:43.657759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600c59f-e1aa-453e-938a-025c9dc2a256 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:43.658010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600c59f-e1aa-453e-938a-025c9dc2a256 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:43.658277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600c59f-e1aa-453e-938a-025c9dc2a256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:43.669489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600c59f-e1aa-453e-938a-025c9dc2a256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:43.671298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600c59f-e1aa-453e-938a-025c9dc2a256 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5600c59f-e1aa-453e-938a-025c9dc2a256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:43.689341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:43.690514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:43.691615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:43.691615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:43.691615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:43.691615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:43.691615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 629/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:43.697072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357264-f368-4c45-99ef-657edffd0700 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:43.799760 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:43.809013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357264-f368-4c45-99ef-657edffd0700 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:43.851198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc2872-55f8-44b6-823f-d76674b0d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:43.851823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2872-55f8-44b6-823f-d76674b0d526 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:43.852105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2872-55f8-44b6-823f-d76674b0d526 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:43.852377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2872-55f8-44b6-823f-d76674b0d526 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:43.853672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2872-55f8-44b6-823f-d76674b0d526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:43.853978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2872-55f8-44b6-823f-d76674b0d526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:43.855376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2872-55f8-44b6-823f-d76674b0d526 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:43.870531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 614/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:43.876282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600c59f-e1aa-453e-938a-025c9dc2a256 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:43.976923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:44.001436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600c59f-e1aa-453e-938a-025c9dc2a256 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:44.037810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d978c8b-1b23-4d59-8f6a-825ffd5d0460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:44.038448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d978c8b-1b23-4d59-8f6a-825ffd5d0460 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:44.038770 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d978c8b-1b23-4d59-8f6a-825ffd5d0460 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:44.039049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d978c8b-1b23-4d59-8f6a-825ffd5d0460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:44.046700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d978c8b-1b23-4d59-8f6a-825ffd5d0460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:44.048244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d978c8b-1b23-4d59-8f6a-825ffd5d0460 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0d978c8b-1b23-4d59-8f6a-825ffd5d0460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:39:44.059810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:44.066015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:44.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:39:44.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:39:44.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:39:44.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:39:44.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:39:44.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:39:44.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:44.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:44.067129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 630/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:44.067733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc2872-55f8-44b6-823f-d76674b0d526 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:44.196055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc2872-55f8-44b6-823f-d76674b0d526 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:44.236773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742ee2f-0fca-4a2e-8e9a-a519bc7e060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:44.237582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ee2f-0fca-4a2e-8e9a-a519bc7e060c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:44.237895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ee2f-0fca-4a2e-8e9a-a519bc7e060c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:44.238169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ee2f-0fca-4a2e-8e9a-a519bc7e060c None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:44.238986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742ee2f-0fca-4a2e-8e9a-a519bc7e060c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:44.239290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742ee2f-0fca-4a2e-8e9a-a519bc7e060c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:44.240728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742ee2f-0fca-4a2e-8e9a-a519bc7e060c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:44.253587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 615/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:44.260276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d978c8b-1b23-4d59-8f6a-825ffd5d0460 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:44.371940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d978c8b-1b23-4d59-8f6a-825ffd5d0460 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:44.410567 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3c86c-42ab-43b1-8877-0a07abfd566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:44.411233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3c86c-42ab-43b1-8877-0a07abfd566a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:44.411485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3c86c-42ab-43b1-8877-0a07abfd566a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:44.411777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3c86c-42ab-43b1-8877-0a07abfd566a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:44.412541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3c86c-42ab-43b1-8877-0a07abfd566a None admin] RBAC: Adding query filter params (role.id=acd4741d776c40b8b1f5563ad208b994, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=beaec3b392e3468981992629101cf883) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:44.412846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3c86c-42ab-43b1-8877-0a07abfd566a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:44.414273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3c86c-42ab-43b1-8877-0a07abfd566a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:44.432814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 631/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:39:44 2022] GET /identity/v3/role_assignments?user.id=beaec3b392e3468981992629101cf883&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=acd4741d776c40b8b1f5563ad208b994 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:46.566162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca0ea9-b758-4c4a-99e7-89daf847aab8 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:46.566686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca0ea9-b758-4c4a-99e7-89daf847aab8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:46.566686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca0ea9-b758-4c4a-99e7-89daf847aab8 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:46.568055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 616/1247] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:39:46.574251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175284-bde2-43d7-aff6-46ac9bcb956c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:46.574761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175284-bde2-43d7-aff6-46ac9bcb956c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:46.574873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175284-bde2-43d7-aff6-46ac9bcb956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:46.581650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:46.596291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-83175284-bde2-43d7-aff6-46ac9bcb956c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:39:46.597710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-83175284-bde2-43d7-aff6-46ac9bcb956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:39:46.674202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 632/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:39:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:39:46.701444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca0ea9-b758-4c4a-99e7-89daf847aab8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:46.722132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:46.833129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca0ea9-b758-4c4a-99e7-89daf847aab8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:46.871112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68498d-44b0-4313-970a-7e7d2cd2ad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:46.871758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68498d-44b0-4313-970a-7e7d2cd2ad87 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:46.872034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68498d-44b0-4313-970a-7e7d2cd2ad87 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:46.872300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68498d-44b0-4313-970a-7e7d2cd2ad87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:46.885834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68498d-44b0-4313-970a-7e7d2cd2ad87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-cf68498d-44b0-4313-970a-7e7d2cd2ad87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:39:46.890925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:46.892121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:46.893320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 617/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:46.898357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175284-bde2-43d7-aff6-46ac9bcb956c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:47.013733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175284-bde2-43d7-aff6-46ac9bcb956c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:47.048990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:47.055673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026fd03-bad0-4224-aa25-3d1c10c71c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:47.056451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026fd03-bad0-4224-aa25-3d1c10c71c34 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:47.056794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026fd03-bad0-4224-aa25-3d1c10c71c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:47.057044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026fd03-bad0-4224-aa25-3d1c10c71c34 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:47.057957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026fd03-bad0-4224-aa25-3d1c10c71c34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:47.058292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026fd03-bad0-4224-aa25-3d1c10c71c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:47.059900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026fd03-bad0-4224-aa25-3d1c10c71c34 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:47.074536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 633/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:47.075806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68498d-44b0-4313-970a-7e7d2cd2ad87 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:47.166631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:47.192090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68498d-44b0-4313-970a-7e7d2cd2ad87 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:47.233703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4d5ac-8d9a-4ba1-8704-78919fe30f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:47.234424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4d5ac-8d9a-4ba1-8704-78919fe30f67 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:47.234814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4d5ac-8d9a-4ba1-8704-78919fe30f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:47.235115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4d5ac-8d9a-4ba1-8704-78919fe30f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:47.248661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4d5ac-8d9a-4ba1-8704-78919fe30f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:47.250154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4d5ac-8d9a-4ba1-8704-78919fe30f67 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2ac4d5ac-8d9a-4ba1-8704-78919fe30f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:47.267571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:47.268665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:47.275016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:47.275016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:47.275016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:47.275016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:47.275016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 618/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:47.275548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026fd03-bad0-4224-aa25-3d1c10c71c34 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:47.384682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026fd03-bad0-4224-aa25-3d1c10c71c34 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:47.423529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669a21e-3b09-43d5-bbec-223bf79afc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:47.424731 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669a21e-3b09-43d5-bbec-223bf79afc39 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:47.425006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669a21e-3b09-43d5-bbec-223bf79afc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:47.425303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669a21e-3b09-43d5-bbec-223bf79afc39 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:47.426006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669a21e-3b09-43d5-bbec-223bf79afc39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:47.426367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669a21e-3b09-43d5-bbec-223bf79afc39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:47.427767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669a21e-3b09-43d5-bbec-223bf79afc39 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:47.441625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 634/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:47.448357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4d5ac-8d9a-4ba1-8704-78919fe30f67 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:47.557473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4d5ac-8d9a-4ba1-8704-78919fe30f67 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:47.583710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:47.593733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87f207-0145-44e6-9088-56d3ed8036c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:47.594382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f207-0145-44e6-9088-56d3ed8036c1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:47.594660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f207-0145-44e6-9088-56d3ed8036c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:47.594946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f207-0145-44e6-9088-56d3ed8036c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:47.604777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87f207-0145-44e6-9088-56d3ed8036c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:47.606168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87f207-0145-44e6-9088-56d3ed8036c1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2d87f207-0145-44e6-9088-56d3ed8036c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:39:47.618198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:47.619454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:47.620399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 619/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:47.627159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669a21e-3b09-43d5-bbec-223bf79afc39 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:47.688083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:47.737512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669a21e-3b09-43d5-bbec-223bf79afc39 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:47.779442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d40c7-69f1-4c82-a1d1-c0595ddfa240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:47.780928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d40c7-69f1-4c82-a1d1-c0595ddfa240 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:47.781361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d40c7-69f1-4c82-a1d1-c0595ddfa240 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:47.783344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d40c7-69f1-4c82-a1d1-c0595ddfa240 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:47.783344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d40c7-69f1-4c82-a1d1-c0595ddfa240 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:47.783344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d40c7-69f1-4c82-a1d1-c0595ddfa240 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:47.784278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d40c7-69f1-4c82-a1d1-c0595ddfa240 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:47.806500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 635/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 27 07:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:47.813642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87f207-0145-44e6-9088-56d3ed8036c1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:47.935233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87f207-0145-44e6-9088-56d3ed8036c1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:47.982299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f76d1-61d2-4600-861a-69b3c1bb8754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:47.983001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f76d1-61d2-4600-861a-69b3c1bb8754 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:47.983427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f76d1-61d2-4600-861a-69b3c1bb8754 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:47.983561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f76d1-61d2-4600-861a-69b3c1bb8754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:48.044403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:48.056913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f76d1-61d2-4600-861a-69b3c1bb8754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:48.058464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f76d1-61d2-4600-861a-69b3c1bb8754 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:48.170538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 620/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:39:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:39:48.177385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d40c7-69f1-4c82-a1d1-c0595ddfa240 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:48.288286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d40c7-69f1-4c82-a1d1-c0595ddfa240 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:48.302295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:48.325811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a99a1c-492e-4ac3-8a3b-5aabed559728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:48.326615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a99a1c-492e-4ac3-8a3b-5aabed559728 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:48.327002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a99a1c-492e-4ac3-8a3b-5aabed559728 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:48.327345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a99a1c-492e-4ac3-8a3b-5aabed559728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:48.338310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a99a1c-492e-4ac3-8a3b-5aabed559728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:48.339850 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a99a1c-492e-4ac3-8a3b-5aabed559728 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b7a99a1c-492e-4ac3-8a3b-5aabed559728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:48.355545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:48.356753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:48.358176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:48.358176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:48.358176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:48.358176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:48.358176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 636/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:48.362494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f76d1-61d2-4600-861a-69b3c1bb8754 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:48.465447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:48.479540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f76d1-61d2-4600-861a-69b3c1bb8754 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:48.519412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9160386-6ec3-4e26-8a83-5119b3c5e707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:48.520150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9160386-6ec3-4e26-8a83-5119b3c5e707 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:48.520580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9160386-6ec3-4e26-8a83-5119b3c5e707 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:48.520893 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9160386-6ec3-4e26-8a83-5119b3c5e707 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:48.521685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9160386-6ec3-4e26-8a83-5119b3c5e707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:48.522017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9160386-6ec3-4e26-8a83-5119b3c5e707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:48.523721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9160386-6ec3-4e26-8a83-5119b3c5e707 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:48.538640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 621/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:48.545229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a99a1c-492e-4ac3-8a3b-5aabed559728 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:48.661767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a99a1c-492e-4ac3-8a3b-5aabed559728 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:48.701465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db96a7-de4d-4ce7-bdc7-e845ecec1016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:48.702020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db96a7-de4d-4ce7-bdc7-e845ecec1016 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:48.702305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db96a7-de4d-4ce7-bdc7-e845ecec1016 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:48.702576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db96a7-de4d-4ce7-bdc7-e845ecec1016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:48.709623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db96a7-de4d-4ce7-bdc7-e845ecec1016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:48.711115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db96a7-de4d-4ce7-bdc7-e845ecec1016 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c2db96a7-de4d-4ce7-bdc7-e845ecec1016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:39:48.723109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:48.724975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:48.731252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:39:48.731252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:39:48.731252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:39:48.731252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:39:48.731252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:39:48.731252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:39:48.731252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:48.731252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:48.731252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 637/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:48.733870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9160386-6ec3-4e26-8a83-5119b3c5e707 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:48.856987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9160386-6ec3-4e26-8a83-5119b3c5e707 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:48.899729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd0c0d-bcf4-463b-ab0a-b87e18253752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:48.900608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd0c0d-bcf4-463b-ab0a-b87e18253752 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:48.900751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd0c0d-bcf4-463b-ab0a-b87e18253752 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:48.901036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd0c0d-bcf4-463b-ab0a-b87e18253752 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:48.901685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd0c0d-bcf4-463b-ab0a-b87e18253752 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:48.901991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd0c0d-bcf4-463b-ab0a-b87e18253752 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:48.903489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd0c0d-bcf4-463b-ab0a-b87e18253752 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:48.921699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 622/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:39:48.929281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db96a7-de4d-4ce7-bdc7-e845ecec1016 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:48.962778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:49.044369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db96a7-de4d-4ce7-bdc7-e845ecec1016 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:49.079839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43e6d0-d7dd-4753-adf9-eaaf42d19923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:49.080462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43e6d0-d7dd-4753-adf9-eaaf42d19923 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:49.080740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43e6d0-d7dd-4753-adf9-eaaf42d19923 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:49.081011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43e6d0-d7dd-4753-adf9-eaaf42d19923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:49.081816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43e6d0-d7dd-4753-adf9-eaaf42d19923 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=beaec3b392e3468981992629101cf883) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:49.082121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43e6d0-d7dd-4753-adf9-eaaf42d19923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:49.083628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43e6d0-d7dd-4753-adf9-eaaf42d19923 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:49.090620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 638/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:39:48 2022] GET /identity/v3/role_assignments?user.id=beaec3b392e3468981992629101cf883&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=2ba3b2926541436a9d26782420538af3 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:51.089284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e27cb-a37c-430e-adae-090c13a687c8 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:51.089819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e27cb-a37c-430e-adae-090c13a687c8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:51.089819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e27cb-a37c-430e-adae-090c13a687c8 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:51.091213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 623/1261] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:39:51.096741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a23add-7e7f-4ed9-9bbc-1edb752acd7e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:51.097124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a23add-7e7f-4ed9-9bbc-1edb752acd7e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:51.097296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a23add-7e7f-4ed9-9bbc-1edb752acd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:51.116267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-93a23add-7e7f-4ed9-9bbc-1edb752acd7e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:39:51.117495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-93a23add-7e7f-4ed9-9bbc-1edb752acd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:39:51.198920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 639/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:39:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 07:39:51.222201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e27cb-a37c-430e-adae-090c13a687c8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:51.233672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:51.324039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e27cb-a37c-430e-adae-090c13a687c8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:51.359094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ce8aa-102d-42dd-b14d-763906793ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:51.359666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce8aa-102d-42dd-b14d-763906793ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:51.359945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce8aa-102d-42dd-b14d-763906793ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:51.360213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce8aa-102d-42dd-b14d-763906793ed9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:51.370125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ce8aa-102d-42dd-b14d-763906793ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-db1ce8aa-102d-42dd-b14d-763906793ed9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:39:51.374998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:51.376065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:51.377081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 624/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:39:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 07:39:51.382345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a23add-7e7f-4ed9-9bbc-1edb752acd7e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:51.400723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:51.485675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a23add-7e7f-4ed9-9bbc-1edb752acd7e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:51.518079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0580b-d38d-4719-b3db-c41be482c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:51.518690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0580b-d38d-4719-b3db-c41be482c129 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:51.519000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0580b-d38d-4719-b3db-c41be482c129 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:51.519278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0580b-d38d-4719-b3db-c41be482c129 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:51.519990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0580b-d38d-4719-b3db-c41be482c129 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:51.520293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0580b-d38d-4719-b3db-c41be482c129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:51.521659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0580b-d38d-4719-b3db-c41be482c129 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:51.530073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 640/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:39:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:51.536075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ce8aa-102d-42dd-b14d-763906793ed9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:51.607068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:51.640486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ce8aa-102d-42dd-b14d-763906793ed9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:51.672812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221e691-0a89-4d52-835d-ca3f7fa8813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:51.673436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e691-0a89-4d52-835d-ca3f7fa8813b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:51.673712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e691-0a89-4d52-835d-ca3f7fa8813b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:51.673980 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e691-0a89-4d52-835d-ca3f7fa8813b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:51.684365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221e691-0a89-4d52-835d-ca3f7fa8813b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:51.685812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221e691-0a89-4d52-835d-ca3f7fa8813b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c221e691-0a89-4d52-835d-ca3f7fa8813b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:51.700100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:51.701150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:51.702273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:51.702273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:51.702273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:51.702273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:51.702273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 625/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:51.707183 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0580b-d38d-4719-b3db-c41be482c129 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:51.786109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:51.805233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0580b-d38d-4719-b3db-c41be482c129 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:51.838980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a09b78-c359-4c88-ab96-85aed79132f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:51.839588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a09b78-c359-4c88-ab96-85aed79132f5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:51.839870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a09b78-c359-4c88-ab96-85aed79132f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:51.840143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a09b78-c359-4c88-ab96-85aed79132f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:51.840834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a09b78-c359-4c88-ab96-85aed79132f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:51.841139 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a09b78-c359-4c88-ab96-85aed79132f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:51.842513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a09b78-c359-4c88-ab96-85aed79132f5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:51.854338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 641/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:51.860112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221e691-0a89-4d52-835d-ca3f7fa8813b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:51.962538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221e691-0a89-4d52-835d-ca3f7fa8813b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:51.982308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:51.996072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca607c-3dff-4f2f-a2ae-50735af19439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:51.996706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca607c-3dff-4f2f-a2ae-50735af19439 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:51.996986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca607c-3dff-4f2f-a2ae-50735af19439 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:51.997255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca607c-3dff-4f2f-a2ae-50735af19439 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:52.004664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca607c-3dff-4f2f-a2ae-50735af19439 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:52.006090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca607c-3dff-4f2f-a2ae-50735af19439 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-57ca607c-3dff-4f2f-a2ae-50735af19439 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:39:52.017048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:52.018172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:52.019553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 626/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:52.024932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a09b78-c359-4c88-ab96-85aed79132f5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:52.125636 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a09b78-c359-4c88-ab96-85aed79132f5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:52.166173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d37a-1720-4071-b598-ee67ddc709ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:52.166778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d37a-1720-4071-b598-ee67ddc709ff None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:52.167085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d37a-1720-4071-b598-ee67ddc709ff None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:52.167356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d37a-1720-4071-b598-ee67ddc709ff None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:52.168152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d37a-1720-4071-b598-ee67ddc709ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:52.168455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d37a-1720-4071-b598-ee67ddc709ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:52.169890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d37a-1720-4071-b598-ee67ddc709ff None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:52.178616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:52.187050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 642/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 27 07:39:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:52.192957 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca607c-3dff-4f2f-a2ae-50735af19439 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:52.292048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca607c-3dff-4f2f-a2ae-50735af19439 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:52.324153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f2548-bbc7-495d-bc62-9b35c7238cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:52.324779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2548-bbc7-495d-bc62-9b35c7238cca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:52.325053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2548-bbc7-495d-bc62-9b35c7238cca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:52.325322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2548-bbc7-495d-bc62-9b35c7238cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:52.335561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f2548-bbc7-495d-bc62-9b35c7238cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:52.337074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f2548-bbc7-495d-bc62-9b35c7238cca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-606f2548-bbc7-495d-bc62-9b35c7238cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:52.351070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:52.352650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:52.353580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:52.353580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:52.353580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:52.353580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:52.353580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 627/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:52.358454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d37a-1720-4071-b598-ee67ddc709ff None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:52.457947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d37a-1720-4071-b598-ee67ddc709ff None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:52.491668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8768a7-d67c-489f-b06d-6cea28cfd7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:52.492268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8768a7-d67c-489f-b06d-6cea28cfd7ad None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:52.492542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8768a7-d67c-489f-b06d-6cea28cfd7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:52.493416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8768a7-d67c-489f-b06d-6cea28cfd7ad None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:52.494103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8768a7-d67c-489f-b06d-6cea28cfd7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:52.494401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8768a7-d67c-489f-b06d-6cea28cfd7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:52.495795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8768a7-d67c-489f-b06d-6cea28cfd7ad None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:52.506671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 643/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:52.512388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f2548-bbc7-495d-bc62-9b35c7238cca None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:52.543523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:52.614405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f2548-bbc7-495d-bc62-9b35c7238cca None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:52.648697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2c3c5-484c-493a-a6d4-7858cd1527d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:52.649360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c3c5-484c-493a-a6d4-7858cd1527d0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:52.649642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c3c5-484c-493a-a6d4-7858cd1527d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:52.649916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c3c5-484c-493a-a6d4-7858cd1527d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:52.656500 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2c3c5-484c-493a-a6d4-7858cd1527d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:52.657959 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2c3c5-484c-493a-a6d4-7858cd1527d0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-dbe2c3c5-484c-493a-a6d4-7858cd1527d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:39:52.670314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:52.671381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:52.672506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:39:52.672506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:39:52.672506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:39:52.672506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:39:52.672506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:39:52.672506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:39:52.672506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:52.672506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:52.672506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 628/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:52.677424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8768a7-d67c-489f-b06d-6cea28cfd7ad None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:52.735236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:52.776925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8768a7-d67c-489f-b06d-6cea28cfd7ad None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:52.810212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd86a58-43c5-4eca-9a82-cdb9a90e380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:52.810755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd86a58-43c5-4eca-9a82-cdb9a90e380f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:52.811065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd86a58-43c5-4eca-9a82-cdb9a90e380f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:52.811342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd86a58-43c5-4eca-9a82-cdb9a90e380f None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:52.812096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd86a58-43c5-4eca-9a82-cdb9a90e380f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:52.812398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd86a58-43c5-4eca-9a82-cdb9a90e380f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:52.813836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd86a58-43c5-4eca-9a82-cdb9a90e380f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:52.826203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 644/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:52.832264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2c3c5-484c-493a-a6d4-7858cd1527d0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:52.923517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:52.933656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2c3c5-484c-493a-a6d4-7858cd1527d0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:52.967189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b367f-5753-48d4-acdc-5f93612f5274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:52.967858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b367f-5753-48d4-acdc-5f93612f5274 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:52.968138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b367f-5753-48d4-acdc-5f93612f5274 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:52.968413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b367f-5753-48d4-acdc-5f93612f5274 None admin] PATH_INFO: `/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/beaec3b392e3468981992629101cf883/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:52.970348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b367f-5753-48d4-acdc-5f93612f5274 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd9a3718f41969b6d191475d1174e, user_id=beaec3b392e3468981992629101cf883, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:52.972074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b367f-5753-48d4-acdc-5f93612f5274 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:52.984454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 629/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 27 07:39:52 2022] PUT /identity/v3/projects/2a4dd9a3718f41969b6d191475d1174e/users/beaec3b392e3468981992629101cf883/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:39:55.020724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e6567-435d-4052-a521-d5a27a234bb3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:55.021297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e6567-435d-4052-a521-d5a27a234bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:55.021297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e6567-435d-4052-a521-d5a27a234bb3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:55.022628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 645/1274] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:39:55.027759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e2962-0222-4dfb-9cdf-867c61a71e5d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:55.028179 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e2962-0222-4dfb-9cdf-867c61a71e5d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:55.028296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e2962-0222-4dfb-9cdf-867c61a71e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:55.046143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f74e2962-0222-4dfb-9cdf-867c61a71e5d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:39:55.047388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f74e2962-0222-4dfb-9cdf-867c61a71e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:39:55.114375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 630/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:39:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:39:55.138555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e6567-435d-4052-a521-d5a27a234bb3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:55.236332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e6567-435d-4052-a521-d5a27a234bb3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:55.253768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:55.270672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eed3d5-7c3e-49b5-846a-3d5b7e559c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:55.271384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eed3d5-7c3e-49b5-846a-3d5b7e559c81 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:55.271612 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eed3d5-7c3e-49b5-846a-3d5b7e559c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:55.271888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eed3d5-7c3e-49b5-846a-3d5b7e559c81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:55.281730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eed3d5-7c3e-49b5-846a-3d5b7e559c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e9eed3d5-7c3e-49b5-846a-3d5b7e559c81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 07:39:55.286548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:55.287756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:55.288807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 646/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 27 07:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:55.294499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e2962-0222-4dfb-9cdf-867c61a71e5d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:55.373474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:55.392155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e2962-0222-4dfb-9cdf-867c61a71e5d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:55.426065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59039ee6-2113-4864-b152-05a6157b919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:55.426382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039ee6-2113-4864-b152-05a6157b919c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:55.426663 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039ee6-2113-4864-b152-05a6157b919c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:55.426967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039ee6-2113-4864-b152-05a6157b919c None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:55.427701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59039ee6-2113-4864-b152-05a6157b919c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:55.428008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59039ee6-2113-4864-b152-05a6157b919c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:55.429379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59039ee6-2113-4864-b152-05a6157b919c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:55.438168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 631/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 27 07:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:55.443967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eed3d5-7c3e-49b5-846a-3d5b7e559c81 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:55.545153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eed3d5-7c3e-49b5-846a-3d5b7e559c81 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:55.578512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbbf13-c796-4f17-9f57-27e66eaff507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:55.579166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbbf13-c796-4f17-9f57-27e66eaff507 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:55.579451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbbf13-c796-4f17-9f57-27e66eaff507 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:55.579724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbbf13-c796-4f17-9f57-27e66eaff507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:55.589622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbbf13-c796-4f17-9f57-27e66eaff507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:55.591091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbbf13-c796-4f17-9f57-27e66eaff507 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d3bbbf13-c796-4f17-9f57-27e66eaff507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:55.606154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:55.607221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:55.608322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:55.608322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:55.608322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:55.608322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:55.608322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 647/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:55.613300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59039ee6-2113-4864-b152-05a6157b919c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:55.710171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59039ee6-2113-4864-b152-05a6157b919c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:55.743364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17fad2-4ea7-4a53-8d15-ab754b7e08a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:55.743978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17fad2-4ea7-4a53-8d15-ab754b7e08a0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:55.744261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17fad2-4ea7-4a53-8d15-ab754b7e08a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:55.744535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17fad2-4ea7-4a53-8d15-ab754b7e08a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:55.745231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17fad2-4ea7-4a53-8d15-ab754b7e08a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:55.745536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17fad2-4ea7-4a53-8d15-ab754b7e08a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:55.746918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17fad2-4ea7-4a53-8d15-ab754b7e08a0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:55.759738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 632/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:55.765502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbbf13-c796-4f17-9f57-27e66eaff507 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:55.795372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:55.863670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbbf13-c796-4f17-9f57-27e66eaff507 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:55.896896 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de25a9-8fcc-4c11-85bc-efd5472013ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:55.897522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de25a9-8fcc-4c11-85bc-efd5472013ba None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:55.897795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de25a9-8fcc-4c11-85bc-efd5472013ba None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:55.898065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de25a9-8fcc-4c11-85bc-efd5472013ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:55.905576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de25a9-8fcc-4c11-85bc-efd5472013ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:55.907058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de25a9-8fcc-4c11-85bc-efd5472013ba None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-71de25a9-8fcc-4c11-85bc-efd5472013ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 07:39:55.918114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:55.919271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:55.920737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 648/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:55.925171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17fad2-4ea7-4a53-8d15-ab754b7e08a0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:55.928921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:56.041518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17fad2-4ea7-4a53-8d15-ab754b7e08a0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:56.074293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f7605-41c0-4a4b-8a1c-41923be10495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:56.074923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f7605-41c0-4a4b-8a1c-41923be10495 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:56.075208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f7605-41c0-4a4b-8a1c-41923be10495 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:56.075479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f7605-41c0-4a4b-8a1c-41923be10495 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:56.076269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f7605-41c0-4a4b-8a1c-41923be10495 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:56.076575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f7605-41c0-4a4b-8a1c-41923be10495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:56.078006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f7605-41c0-4a4b-8a1c-41923be10495 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:56.096157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 633/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 27 07:39:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:56.101929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de25a9-8fcc-4c11-85bc-efd5472013ba None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:56.191330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:56.201147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de25a9-8fcc-4c11-85bc-efd5472013ba None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:56.234796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa2173-b20e-488f-9360-e4a63bc586cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:56.235431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa2173-b20e-488f-9360-e4a63bc586cf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:56.235710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa2173-b20e-488f-9360-e4a63bc586cf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:56.235982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa2173-b20e-488f-9360-e4a63bc586cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:56.301555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa2173-b20e-488f-9360-e4a63bc586cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:56.303051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa2173-b20e-488f-9360-e4a63bc586cf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:56.391858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:56.402357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 649/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 27 07:39:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 07:39:56.408201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f7605-41c0-4a4b-8a1c-41923be10495 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:56.471130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:56.509638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f7605-41c0-4a4b-8a1c-41923be10495 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:56.541710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f4b1c-4cdb-43ee-aa13-46cfbd633540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:56.542364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f4b1c-4cdb-43ee-aa13-46cfbd633540 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:56.542637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f4b1c-4cdb-43ee-aa13-46cfbd633540 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:56.542922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f4b1c-4cdb-43ee-aa13-46cfbd633540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:56.552671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f4b1c-4cdb-43ee-aa13-46cfbd633540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:56.554108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f4b1c-4cdb-43ee-aa13-46cfbd633540 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-954f4b1c-4cdb-43ee-aa13-46cfbd633540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 07:39:56.568860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:56.569918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:56.571518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 07:39:56.571518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 07:39:56.571518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 07:39:56.571518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:56.571518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 634/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:56.576256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa2173-b20e-488f-9360-e4a63bc586cf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:56.690537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa2173-b20e-488f-9360-e4a63bc586cf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:56.723936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f43cba-857a-497b-b711-edabad2a8a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:56.724543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f43cba-857a-497b-b711-edabad2a8a85 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:56.724823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f43cba-857a-497b-b711-edabad2a8a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:56.725097 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f43cba-857a-497b-b711-edabad2a8a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:56.725815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f43cba-857a-497b-b711-edabad2a8a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:56.726121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f43cba-857a-497b-b711-edabad2a8a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:56.727547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f43cba-857a-497b-b711-edabad2a8a85 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:56.738435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 650/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 27 07:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:56.744643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f4b1c-4cdb-43ee-aa13-46cfbd633540 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:56.844720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f4b1c-4cdb-43ee-aa13-46cfbd633540 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:56.858623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:56.879336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5a51-6daf-4497-9f5f-238d3605acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:56.880002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5a51-6daf-4497-9f5f-238d3605acea None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:56.880283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5a51-6daf-4497-9f5f-238d3605acea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:56.880557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5a51-6daf-4497-9f5f-238d3605acea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:56.887627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c5a51-6daf-4497-9f5f-238d3605acea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:56.889066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c5a51-6daf-4497-9f5f-238d3605acea None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-186c5a51-6daf-4497-9f5f-238d3605acea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 07:39:56.900533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:56.901587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:56.902712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 07:39:56.902712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 07:39:56.902712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 07:39:56.902712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 07:39:56.902712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 07:39:56.902712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 07:39:56.902712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 07:39:56.902712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jul 27 07:39:56.902712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 635/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 27 07:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:56.907764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f43cba-857a-497b-b711-edabad2a8a85 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:56.966086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:57.016666 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f43cba-857a-497b-b711-edabad2a8a85 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:57.049093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7fe3f-922d-4713-ae52-d42a4006462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:57.049693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7fe3f-922d-4713-ae52-d42a4006462e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:57.049969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7fe3f-922d-4713-ae52-d42a4006462e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:57.050237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7fe3f-922d-4713-ae52-d42a4006462e None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:57.051000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7fe3f-922d-4713-ae52-d42a4006462e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:57.051303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7fe3f-922d-4713-ae52-d42a4006462e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:57.052723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7fe3f-922d-4713-ae52-d42a4006462e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:57.064260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 651/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 27 07:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:57.070531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5a51-6daf-4497-9f5f-238d3605acea None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:57.177660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5a51-6daf-4497-9f5f-238d3605acea None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:57.210728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1f416-dea6-4be4-8683-9b2dad699dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:57.211388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1f416-dea6-4be4-8683-9b2dad699dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:57.211666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1f416-dea6-4be4-8683-9b2dad699dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:57.211936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1f416-dea6-4be4-8683-9b2dad699dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:57.212719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1f416-dea6-4be4-8683-9b2dad699dd2 None admin] RBAC: Adding query filter params (role.id=2ba3b2926541436a9d26782420538af3, scope.project.id=2a4dd9a3718f41969b6d191475d1174e, user.id=beaec3b392e3468981992629101cf883) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:57.213026 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1f416-dea6-4be4-8683-9b2dad699dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:57.214448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1f416-dea6-4be4-8683-9b2dad699dd2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:57.220914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 636/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 27 07:39:57 2022] GET /identity/v3/role_assignments?user.id=beaec3b392e3468981992629101cf883&scope.project.id=2a4dd9a3718f41969b6d191475d1174e&role.id=2ba3b2926541436a9d26782420538af3 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:59.258303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557082-0d23-4c12-825b-a707dd43fdb6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:59.258917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557082-0d23-4c12-825b-a707dd43fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:59.258917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557082-0d23-4c12-825b-a707dd43fdb6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:59.260257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 652/1288] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:39:59.265533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d99a8-ba90-4c84-961c-a1ef6854da43 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:59.266001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d99a8-ba90-4c84-961c-a1ef6854da43 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:59.266101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d99a8-ba90-4c84-961c-a1ef6854da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:59.283883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-654d99a8-ba90-4c84-961c-a1ef6854da43 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:39:59.285085 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-654d99a8-ba90-4c84-961c-a1ef6854da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:39:59.314798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:59.356285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 637/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:39:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:39:59.379037 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557082-0d23-4c12-825b-a707dd43fdb6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:59.485374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557082-0d23-4c12-825b-a707dd43fdb6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:59.496169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:39:59.520492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221b84a-0761-446c-a41d-7b6b137909f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:59.521061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221b84a-0761-446c-a41d-7b6b137909f2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:59.521340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221b84a-0761-446c-a41d-7b6b137909f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:59.521621 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221b84a-0761-446c-a41d-7b6b137909f2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:59.522245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221b84a-0761-446c-a41d-7b6b137909f2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:59.524187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221b84a-0761-446c-a41d-7b6b137909f2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9221b84a-0761-446c-a41d-7b6b137909f2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:39:59.532870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:39:59.538950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:39:59.540656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 653/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:39:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:39:59.541722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d99a8-ba90-4c84-961c-a1ef6854da43 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:59.635233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d99a8-ba90-4c84-961c-a1ef6854da43 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:59.669689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9959-bd73-45aa-a76d-ef186fc238b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:59.670307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9959-bd73-45aa-a76d-ef186fc238b9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:59.670587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9959-bd73-45aa-a76d-ef186fc238b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:59.670856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9959-bd73-45aa-a76d-ef186fc238b9 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:59.671609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e9959-bd73-45aa-a76d-ef186fc238b9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:59.671917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e9959-bd73-45aa-a76d-ef186fc238b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:59.673279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e9959-bd73-45aa-a76d-ef186fc238b9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:59.678102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 638/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jul 27 07:39:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:39:59.683952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221b84a-0761-446c-a41d-7b6b137909f2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:39:59.786940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221b84a-0761-446c-a41d-7b6b137909f2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:39:59.819904 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6cd1-63bd-4a2f-8578-9963333e79c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:39:59.821046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6cd1-63bd-4a2f-8578-9963333e79c1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:39:59.821324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6cd1-63bd-4a2f-8578-9963333e79c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:39:59.821592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6cd1-63bd-4a2f-8578-9963333e79c1 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:39:59.822263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d6cd1-63bd-4a2f-8578-9963333e79c1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:39:59.822565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d6cd1-63bd-4a2f-8578-9963333e79c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:39:59.823957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d6cd1-63bd-4a2f-8578-9963333e79c1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:39:59.828674 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 654/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jul 27 07:39:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:40:01.823390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91b83-800b-4c5b-b424-259548a2a550 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:01.823932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91b83-800b-4c5b-b424-259548a2a550 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:01.823932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91b83-800b-4c5b-b424-259548a2a550 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:01.825276 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 639/1293] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:40:01.830370 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c9f48-9569-4008-9562-04ff2ed981dc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:01.830762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c9f48-9569-4008-9562-04ff2ed981dc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:01.830951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c9f48-9569-4008-9562-04ff2ed981dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:01.848983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-050c9f48-9569-4008-9562-04ff2ed981dc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:40:01.850166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-050c9f48-9569-4008-9562-04ff2ed981dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:40:01.879286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:40:01.917692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 655/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:40:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:40:01.941167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91b83-800b-4c5b-b424-259548a2a550 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:40:01.975463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:40:02.048923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91b83-800b-4c5b-b424-259548a2a550 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:40:02.082488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105aaa13-06f7-449b-aeb8-00f84afc9ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:40:02.083180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aaa13-06f7-449b-aeb8-00f84afc9ef1 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:02.083459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aaa13-06f7-449b-aeb8-00f84afc9ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:02.083730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aaa13-06f7-449b-aeb8-00f84afc9ef1 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:02.084424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105aaa13-06f7-449b-aeb8-00f84afc9ef1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:40:02.085790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105aaa13-06f7-449b-aeb8-00f84afc9ef1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:40:02.100839 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 640/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 27 07:40:01 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:40:04.166160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfeb5b-a1f7-49ea-bb6e-00303a26e8a5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:04.167532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfeb5b-a1f7-49ea-bb6e-00303a26e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:04.167532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfeb5b-a1f7-49ea-bb6e-00303a26e8a5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:04.168063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 656/1296] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:40:04.173901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79718e-5e5e-4cac-80f9-88be53b82942 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:04.174558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79718e-5e5e-4cac-80f9-88be53b82942 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:04.174558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79718e-5e5e-4cac-80f9-88be53b82942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:04.193775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dd79718e-5e5e-4cac-80f9-88be53b82942 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:40:04.195006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dd79718e-5e5e-4cac-80f9-88be53b82942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:40:04.269159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 641/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:40:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:40:04.292125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfeb5b-a1f7-49ea-bb6e-00303a26e8a5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:40:04.389665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfeb5b-a1f7-49ea-bb6e-00303a26e8a5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:40:04.422615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576f213-0ece-46ab-91f2-73d1fbe9b7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:40:04.423205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576f213-0ece-46ab-91f2-73d1fbe9b7ec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:04.423480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576f213-0ece-46ab-91f2-73d1fbe9b7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:04.423747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576f213-0ece-46ab-91f2-73d1fbe9b7ec None admin] PATH_INFO: `/v3/services/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:04.424373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576f213-0ece-46ab-91f2-73d1fbe9b7ec None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:40:04.426086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576f213-0ece-46ab-91f2-73d1fbe9b7ec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0576f213-0ece-46ab-91f2-73d1fbe9b7ec None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:40:04.435190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:40:04.436470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:40:04.437688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 657/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:40:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:40:04.442372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79718e-5e5e-4cac-80f9-88be53b82942 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:40:04.463970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:40:04.548501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79718e-5e5e-4cac-80f9-88be53b82942 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:40:04.581709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d96a-a4ba-4225-8530-16adf23528a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:40:04.582324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d96a-a4ba-4225-8530-16adf23528a1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:04.582625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d96a-a4ba-4225-8530-16adf23528a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:04.582925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d96a-a4ba-4225-8530-16adf23528a1 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:04.583610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d96a-a4ba-4225-8530-16adf23528a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:40:04.584028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d96a-a4ba-4225-8530-16adf23528a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:40:04.585319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d96a-a4ba-4225-8530-16adf23528a1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:40:04.590356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 642/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jul 27 07:40:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:40:04.596770 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576f213-0ece-46ab-91f2-73d1fbe9b7ec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:40:04.628405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:40:04.695665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576f213-0ece-46ab-91f2-73d1fbe9b7ec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:40:04.728246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd9a2-7b8c-4445-8086-51637a237eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:40:04.728853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd9a2-7b8c-4445-8086-51637a237eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:04.729134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd9a2-7b8c-4445-8086-51637a237eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:04.729410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd9a2-7b8c-4445-8086-51637a237eb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:04.730167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edd9a2-7b8c-4445-8086-51637a237eb7 None admin] RBAC: Adding query filter params (interface=public, service_id=adea652f2d1c44929a7448c59ab87f85, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:40:04.730477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edd9a2-7b8c-4445-8086-51637a237eb7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:40:04.731876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edd9a2-7b8c-4445-8086-51637a237eb7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:40:04.736761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 658/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 27 07:40:04 2022] GET /identity/v3/endpoints?service_id=adea652f2d1c44929a7448c59ab87f85&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:40:04.743134 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d96a-a4ba-4225-8530-16adf23528a1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:40:04.823570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:40:04.841589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d96a-a4ba-4225-8530-16adf23528a1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:40:04.874725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4daf26-5fff-425d-93dd-3aded8337366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:40:04.875370 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4daf26-5fff-425d-93dd-3aded8337366 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:04.875659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4daf26-5fff-425d-93dd-3aded8337366 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:04.875932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4daf26-5fff-425d-93dd-3aded8337366 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:04.876588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4daf26-5fff-425d-93dd-3aded8337366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:40:04.877945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4daf26-5fff-425d-93dd-3aded8337366 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:40:04.885140 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 643/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 27 07:40:04 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:40:06.887697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff23d7-a95a-42ea-afd6-fd9ffff342da None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:06.888285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff23d7-a95a-42ea-afd6-fd9ffff342da None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:06.888285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff23d7-a95a-42ea-afd6-fd9ffff342da None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:06.889602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 659/1302] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:40:06.894941 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b55d2f-c971-4f0a-97ef-b51113784702 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:06.895422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b55d2f-c971-4f0a-97ef-b51113784702 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:06.895523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b55d2f-c971-4f0a-97ef-b51113784702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:06.913861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-94b55d2f-c971-4f0a-97ef-b51113784702 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:40:06.915095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-94b55d2f-c971-4f0a-97ef-b51113784702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:40:06.980126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 644/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:40:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 07:40:07.002854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff23d7-a95a-42ea-afd6-fd9ffff342da None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:40:07.095505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:40:07.103049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff23d7-a95a-42ea-afd6-fd9ffff342da None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:40:07.142614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6067ac-5e76-4ed2-a09e-02d564706ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:40:07.143194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6067ac-5e76-4ed2-a09e-02d564706ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:07.143475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6067ac-5e76-4ed2-a09e-02d564706ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:07.143934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6067ac-5e76-4ed2-a09e-02d564706ac5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:07.144561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6067ac-5e76-4ed2-a09e-02d564706ac5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:40:07.145914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6067ac-5e76-4ed2-a09e-02d564706ac5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5f6067ac-5e76-4ed2-a09e-02d564706ac5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 07:40:07.155274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 07:40:07.156509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jul 27 07:40:07.157555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 660/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 27 07:40:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 07:40:07.162625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b55d2f-c971-4f0a-97ef-b51113784702 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:40:07.240384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:40:07.264080 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b55d2f-c971-4f0a-97ef-b51113784702 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:40:07.297985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5da5e-f3b4-49c0-946d-2baf69bff5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:40:07.298597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5da5e-f3b4-49c0-946d-2baf69bff5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:07.298873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5da5e-f3b4-49c0-946d-2baf69bff5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:07.299172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5da5e-f3b4-49c0-946d-2baf69bff5a0 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:07.299856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5da5e-f3b4-49c0-946d-2baf69bff5a0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:40:07.300157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5da5e-f3b4-49c0-946d-2baf69bff5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:40:07.301517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5da5e-f3b4-49c0-946d-2baf69bff5a0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:40:07.307212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 645/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jul 27 07:40:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:40:07.313130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6067ac-5e76-4ed2-a09e-02d564706ac5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:40:07.408728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6067ac-5e76-4ed2-a09e-02d564706ac5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:40:07.443727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6026ab-66fa-4501-acc9-ace2374294d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:40:07.444338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6026ab-66fa-4501-acc9-ace2374294d7 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:40:07.444613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6026ab-66fa-4501-acc9-ace2374294d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:40:07.444883 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6026ab-66fa-4501-acc9-ace2374294d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:40:07.445609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6026ab-66fa-4501-acc9-ace2374294d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:40:07.447051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6026ab-66fa-4501-acc9-ace2374294d7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:40:07.466046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 661/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:40:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:40:17.303617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=30 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:40:17.462249 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:10.442339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf86b12-c12e-49ee-849a-14c2e0f864f1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:10.442946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf86b12-c12e-49ee-849a-14c2e0f864f1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:10.442946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf86b12-c12e-49ee-849a-14c2e0f864f1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:10.444258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 646/1307] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:10.449442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe5de6-f2b4-4516-b3ea-956e0a83621b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:10.449870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe5de6-f2b4-4516-b3ea-956e0a83621b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:10.450089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe5de6-f2b4-4516-b3ea-956e0a83621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:10.537124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3abe5de6-f2b4-4516-b3ea-956e0a83621b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:10.538725 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3abe5de6-f2b4-4516-b3ea-956e0a83621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:10.727165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 662/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:41:10.782474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8608b29-ff4f-4c52-b949-852b2faee610 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:10.782756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8608b29-ff4f-4c52-b949-852b2faee610 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:10.783072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8608b29-ff4f-4c52-b949-852b2faee610 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:10.784705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 647/1309] 10.222.0.18 () {54 vars in 965 bytes} [Wed Jul 27 07:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:10.791419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d49f68-9704-43ad-a92f-bdb70b0116a0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:10.791697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d49f68-9704-43ad-a92f-bdb70b0116a0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:10.791976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d49f68-9704-43ad-a92f-bdb70b0116a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:10.886951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-68d49f68-9704-43ad-a92f-bdb70b0116a0 None None] MFA Rules not processed for user `0c65277d89a24081a47a7f928f6c6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:10.888245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68d49f68-9704-43ad-a92f-bdb70b0116a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:10.914573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:10.987022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 663/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Jul 27 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:41:10.994082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8608b29-ff4f-4c52-b949-852b2faee610 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:10.995932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d8608b29-ff4f-4c52-b949-852b2faee610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:11.124732 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8608b29-ff4f-4c52-b949-852b2faee610 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:11.203484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a47e40-6e24-46ae-82ce-926d28e019bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:11.204111 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a47e40-6e24-46ae-82ce-926d28e019bb service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:11.204389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a47e40-6e24-46ae-82ce-926d28e019bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:11.204660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a47e40-6e24-46ae-82ce-926d28e019bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:11.206294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-80a47e40-6e24-46ae-82ce-926d28e019bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:11.263616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:11.321644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a47e40-6e24-46ae-82ce-926d28e019bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:11.323116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a47e40-6e24-46ae-82ce-926d28e019bb service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:11.345171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 648/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:13.691877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1016da-93a4-44fd-b8cb-334092f00a80 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:13.692414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1016da-93a4-44fd-b8cb-334092f00a80 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:13.692414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1016da-93a4-44fd-b8cb-334092f00a80 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:13.693838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 664/1312] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:13.699204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2934e4-9907-4e27-b924-d39b4c041954 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:13.699650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2934e4-9907-4e27-b924-d39b4c041954 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:13.699800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2934e4-9907-4e27-b924-d39b4c041954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:13.792187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fd2934e4-9907-4e27-b924-d39b4c041954 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:13.793532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fd2934e4-9907-4e27-b924-d39b4c041954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:13.914260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 649/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:13.973604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3363e0-c332-45ae-aaab-bd3495e66163 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:13.973937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3363e0-c332-45ae-aaab-bd3495e66163 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:13.974150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3363e0-c332-45ae-aaab-bd3495e66163 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:13.975694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 665/1314] 10.222.0.18 () {54 vars in 965 bytes} [Wed Jul 27 07:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:13.981688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2c9eb-4356-4f33-9813-25a8dabce9a2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:13.981987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2c9eb-4356-4f33-9813-25a8dabce9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:13.982466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2c9eb-4356-4f33-9813-25a8dabce9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:13.995286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:14.079662 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1eb2c9eb-4356-4f33-9813-25a8dabce9a2 None None] MFA Rules not processed for user `0c65277d89a24081a47a7f928f6c6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:14.080895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1eb2c9eb-4356-4f33-9813-25a8dabce9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:14.174492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 650/1315] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Jul 27 07:41:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:14.184892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3363e0-c332-45ae-aaab-bd3495e66163 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:14.186515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-aa3363e0-c332-45ae-aaab-bd3495e66163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:14.311893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3363e0-c332-45ae-aaab-bd3495e66163 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:14.387720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:14.390693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc53e1b-0e9e-4427-8354-7ed2d649d7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:14.391576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc53e1b-0e9e-4427-8354-7ed2d649d7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:14.392009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc53e1b-0e9e-4427-8354-7ed2d649d7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:14.392336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc53e1b-0e9e-4427-8354-7ed2d649d7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:14.394197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-adc53e1b-0e9e-4427-8354-7ed2d649d7e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:14.515526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc53e1b-0e9e-4427-8354-7ed2d649d7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:14.516979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc53e1b-0e9e-4427-8354-7ed2d649d7e6 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:14.534791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 666/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:17.137308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f582d1-4727-42e9-9696-42944c34a3d0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:17.137884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f582d1-4727-42e9-9696-42944c34a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:17.137884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f582d1-4727-42e9-9696-42944c34a3d0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:17.139246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 651/1317] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:17.144262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f46f-c31e-43b0-98e1-f7d16037fcee None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:17.145509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f46f-c31e-43b0-98e1-f7d16037fcee None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:17.145509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f46f-c31e-43b0-98e1-f7d16037fcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:17.209996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a331f46f-c31e-43b0-98e1-f7d16037fcee None None] MFA Rules not processed for user `b8d6cc1775b14b0db17609fec02d67a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:17.211233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a331f46f-c31e-43b0-98e1-f7d16037fcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:17.262274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:17.306103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 667/1318] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:17.345617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f582d1-4727-42e9-9696-42944c34a3d0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:17.347235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-15f582d1-4727-42e9-9696-42944c34a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:17.457053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f582d1-4727-42e9-9696-42944c34a3d0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:17.459905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:17.529667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6e47b-7745-4d4a-a3ab-947a3c768ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:17.530279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6e47b-7745-4d4a-a3ab-947a3c768ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:17.530559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6e47b-7745-4d4a-a3ab-947a3c768ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:17.530830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6e47b-7745-4d4a-a3ab-947a3c768ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:17.532495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7aa6e47b-7745-4d4a-a3ab-947a3c768ae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:17.642203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6e47b-7745-4d4a-a3ab-947a3c768ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:17.643673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6e47b-7745-4d4a-a3ab-947a3c768ae6 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:17.663275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 652/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:20.384439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d9c92-123e-449c-909f-667557b4c232 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:20.384976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d9c92-123e-449c-909f-667557b4c232 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:20.384976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d9c92-123e-449c-909f-667557b4c232 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:20.386398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 668/1320] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:20.391488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd014bc-170d-4203-9d60-27c7b26fda04 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:20.391908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd014bc-170d-4203-9d60-27c7b26fda04 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:20.392069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd014bc-170d-4203-9d60-27c7b26fda04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:20.434289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:20.460121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5cd014bc-170d-4203-9d60-27c7b26fda04 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:20.461341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5cd014bc-170d-4203-9d60-27c7b26fda04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:20.555675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 653/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:20.593477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d9c92-123e-449c-909f-667557b4c232 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:20.595356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-507d9c92-123e-449c-909f-667557b4c232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:20.699736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d9c92-123e-449c-909f-667557b4c232 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:20.770992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fb9a1-c5aa-451b-9406-fe95f258f3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:20.771606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fb9a1-c5aa-451b-9406-fe95f258f3eb service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:20.771887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fb9a1-c5aa-451b-9406-fe95f258f3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:20.772161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fb9a1-c5aa-451b-9406-fe95f258f3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:20.773803 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-666fb9a1-c5aa-451b-9406-fe95f258f3eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:20.781258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:20.883031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fb9a1-c5aa-451b-9406-fe95f258f3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:20.884487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fb9a1-c5aa-451b-9406-fe95f258f3eb service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:20.903010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 669/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:23.652082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e2d5-8a9c-442b-961f-9f858b3e5129 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:23.652658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e2d5-8a9c-442b-961f-9f858b3e5129 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:23.652658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e2d5-8a9c-442b-961f-9f858b3e5129 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:23.653967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 654/1323] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:23.659137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49aae1-e410-4393-af4b-a9909c942877 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:23.659788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49aae1-e410-4393-af4b-a9909c942877 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:23.659788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49aae1-e410-4393-af4b-a9909c942877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:23.728219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8c49aae1-e410-4393-af4b-a9909c942877 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:23.729348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8c49aae1-e410-4393-af4b-a9909c942877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:23.788272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:23.834727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 670/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:41:23.872772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0e2d5-8a9c-442b-961f-9f858b3e5129 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:23.874302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-86e0e2d5-8a9c-442b-961f-9f858b3e5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:23.988051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0e2d5-8a9c-442b-961f-9f858b3e5129 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:24.000981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:24.064058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c3452-0fc0-4e85-951f-669d1150bb1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:24.064685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3452-0fc0-4e85-951f-669d1150bb1c service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:24.064967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3452-0fc0-4e85-951f-669d1150bb1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:24.065241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c3452-0fc0-4e85-951f-669d1150bb1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:24.066979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-232c3452-0fc0-4e85-951f-669d1150bb1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:24.178238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c3452-0fc0-4e85-951f-669d1150bb1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:24.179891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c3452-0fc0-4e85-951f-669d1150bb1c service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:24.198251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 655/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:26.291879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5dab-946e-4356-9eda-b8537c554543 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:26.292411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5dab-946e-4356-9eda-b8537c554543 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:26.292411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5dab-946e-4356-9eda-b8537c554543 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:26.293704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 671/1326] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:26.298958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca3b3-4bcb-4474-a0bd-d7c9b371d60b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:26.299359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca3b3-4bcb-4474-a0bd-d7c9b371d60b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:26.299619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca3b3-4bcb-4474-a0bd-d7c9b371d60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:26.353514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:26.372717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-467ca3b3-4bcb-4474-a0bd-d7c9b371d60b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:26.373948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-467ca3b3-4bcb-4474-a0bd-d7c9b371d60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:26.472493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 656/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:41:26.509930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa5dab-946e-4356-9eda-b8537c554543 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:26.511509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-20fa5dab-946e-4356-9eda-b8537c554543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:26.617144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa5dab-946e-4356-9eda-b8537c554543 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:26.691717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ee7ce-6be3-4bdd-8d68-9c192d7375d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:26.692357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ee7ce-6be3-4bdd-8d68-9c192d7375d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:26.692639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ee7ce-6be3-4bdd-8d68-9c192d7375d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:26.692915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ee7ce-6be3-4bdd-8d68-9c192d7375d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:26.694667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2a1ee7ce-6be3-4bdd-8d68-9c192d7375d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:26.715366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:26.811278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ee7ce-6be3-4bdd-8d68-9c192d7375d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:26.812727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ee7ce-6be3-4bdd-8d68-9c192d7375d7 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:26.830412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 672/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:28.905241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73886da4-af20-4092-925a-780649e186f9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:28.905787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73886da4-af20-4092-925a-780649e186f9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:28.905787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73886da4-af20-4092-925a-780649e186f9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:28.907182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 657/1329] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:28.912909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05170ac4-b8e6-47c0-92be-7a7b8d6a2929 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:28.913324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05170ac4-b8e6-47c0-92be-7a7b8d6a2929 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:28.913464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05170ac4-b8e6-47c0-92be-7a7b8d6a2929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:28.980120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-05170ac4-b8e6-47c0-92be-7a7b8d6a2929 None None] MFA Rules not processed for user `b8d6cc1775b14b0db17609fec02d67a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:28.981352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-05170ac4-b8e6-47c0-92be-7a7b8d6a2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:29.044695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:29.078034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 673/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:29.116565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73886da4-af20-4092-925a-780649e186f9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:29.118227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-73886da4-af20-4092-925a-780649e186f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:29.228010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73886da4-af20-4092-925a-780649e186f9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:29.249141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:29.304444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea42c46-e714-4a68-8f16-9fe17001f9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:29.305064 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42c46-e714-4a68-8f16-9fe17001f9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:29.305344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42c46-e714-4a68-8f16-9fe17001f9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:29.305614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42c46-e714-4a68-8f16-9fe17001f9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:29.307260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cea42c46-e714-4a68-8f16-9fe17001f9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:29.427746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea42c46-e714-4a68-8f16-9fe17001f9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:29.428719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea42c46-e714-4a68-8f16-9fe17001f9dc service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:29.448203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 658/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:31.757712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bbe22-3ba0-4d2f-a24a-bac71dc62d21 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:31.758314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bbe22-3ba0-4d2f-a24a-bac71dc62d21 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:31.758314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bbe22-3ba0-4d2f-a24a-bac71dc62d21 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:31.759695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 674/1332] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:31.765096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89019e-9237-4126-8e99-1e0be1b6e020 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:31.765520 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89019e-9237-4126-8e99-1e0be1b6e020 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:31.765652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89019e-9237-4126-8e99-1e0be1b6e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:31.828182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:31.832038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2e89019e-9237-4126-8e99-1e0be1b6e020 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:31.833654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2e89019e-9237-4126-8e99-1e0be1b6e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:31.931674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 659/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:31.968692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bbe22-3ba0-4d2f-a24a-bac71dc62d21 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:31.970512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-896bbe22-3ba0-4d2f-a24a-bac71dc62d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:32.073807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bbe22-3ba0-4d2f-a24a-bac71dc62d21 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:32.148172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fcbf1-4070-49e6-9204-c7af5de2906b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:32.148703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fcbf1-4070-49e6-9204-c7af5de2906b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:32.149005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fcbf1-4070-49e6-9204-c7af5de2906b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:32.149255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fcbf1-4070-49e6-9204-c7af5de2906b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:32.150862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0d2fcbf1-4070-49e6-9204-c7af5de2906b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:32.177318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:32.261509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fcbf1-4070-49e6-9204-c7af5de2906b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:32.263034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fcbf1-4070-49e6-9204-c7af5de2906b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:32.281678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 675/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:34.354441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b337e2-c273-4e24-9bd8-84aa777b8a17 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:34.355020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b337e2-c273-4e24-9bd8-84aa777b8a17 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:34.355020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b337e2-c273-4e24-9bd8-84aa777b8a17 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:34.356357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 660/1335] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:34.361482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf41a7f-8fea-456b-820d-03d2741e99fc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:34.361872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf41a7f-8fea-456b-820d-03d2741e99fc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:34.362055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf41a7f-8fea-456b-820d-03d2741e99fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:34.431577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6cf41a7f-8fea-456b-820d-03d2741e99fc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:34.432797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6cf41a7f-8fea-456b-820d-03d2741e99fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:34.511450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:34.534028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 676/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:34.574324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b337e2-c273-4e24-9bd8-84aa777b8a17 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:34.575917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a5b337e2-c273-4e24-9bd8-84aa777b8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:34.676924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b337e2-c273-4e24-9bd8-84aa777b8a17 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:34.703844 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:34.748537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42663b29-457c-46bd-870a-4d6e892ac062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:34.749144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42663b29-457c-46bd-870a-4d6e892ac062 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:34.749419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42663b29-457c-46bd-870a-4d6e892ac062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:34.749675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42663b29-457c-46bd-870a-4d6e892ac062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:34.751306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-42663b29-457c-46bd-870a-4d6e892ac062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:34.860644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42663b29-457c-46bd-870a-4d6e892ac062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:34.862076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42663b29-457c-46bd-870a-4d6e892ac062 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:34.880240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 661/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:37.368575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f55d-ea8e-4f71-9120-0dff398a9ae8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:37.369142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f55d-ea8e-4f71-9120-0dff398a9ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:37.369142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f55d-ea8e-4f71-9120-0dff398a9ae8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:37.370472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 677/1338] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:37.375645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28452de-e3ca-4969-8f98-a90acfe51cd7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:37.376036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28452de-e3ca-4969-8f98-a90acfe51cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:37.376198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28452de-e3ca-4969-8f98-a90acfe51cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:37.445593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c28452de-e3ca-4969-8f98-a90acfe51cd7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:37.446814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c28452de-e3ca-4969-8f98-a90acfe51cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:37.455385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:37.542213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 662/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:37.579056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732f55d-ea8e-4f71-9120-0dff398a9ae8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:37.580566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9732f55d-ea8e-4f71-9120-0dff398a9ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:37.685465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732f55d-ea8e-4f71-9120-0dff398a9ae8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:37.758267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0379249-a84d-40bc-a614-7c442c3154be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:37.758963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0379249-a84d-40bc-a614-7c442c3154be service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:37.759269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0379249-a84d-40bc-a614-7c442c3154be service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:37.759594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0379249-a84d-40bc-a614-7c442c3154be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:37.761280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d0379249-a84d-40bc-a614-7c442c3154be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:37.796601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:37.873154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0379249-a84d-40bc-a614-7c442c3154be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:37.874587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0379249-a84d-40bc-a614-7c442c3154be service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:37.897804 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 678/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:41.901213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2354-2563-4ede-827b-2db4941767a6 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:41.901772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2354-2563-4ede-827b-2db4941767a6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:41.901772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2354-2563-4ede-827b-2db4941767a6 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:41.903362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 663/1341] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:41.908435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037d2a7-a269-4825-ab56-d1919a55c375 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:41.908885 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037d2a7-a269-4825-ab56-d1919a55c375 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:41.909004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037d2a7-a269-4825-ab56-d1919a55c375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:41.981590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e037d2a7-a269-4825-ab56-d1919a55c375 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:41.982811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e037d2a7-a269-4825-ab56-d1919a55c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:42.081712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:42.093869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 679/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:42.134726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e2354-2563-4ede-827b-2db4941767a6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:42.136306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e48e2354-2563-4ede-827b-2db4941767a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:42.248755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e2354-2563-4ede-827b-2db4941767a6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:42.287130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:42.324120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134e4b0-af9b-44cd-be4c-55c4e2c65e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:42.324745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e4b0-af9b-44cd-be4c-55c4e2c65e48 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:42.325031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e4b0-af9b-44cd-be4c-55c4e2c65e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:42.325302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e4b0-af9b-44cd-be4c-55c4e2c65e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:42.326998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1134e4b0-af9b-44cd-be4c-55c4e2c65e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:42.444791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134e4b0-af9b-44cd-be4c-55c4e2c65e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:42.446170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134e4b0-af9b-44cd-be4c-55c4e2c65e48 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:42.465407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 664/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:41:45.077173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb976d-a645-4bdb-9efe-a4195fdfb06d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:45.077720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb976d-a645-4bdb-9efe-a4195fdfb06d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:45.077720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb976d-a645-4bdb-9efe-a4195fdfb06d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:45.079171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 680/1344] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:45.085099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a17e88-7d67-4a54-a906-9b9ddc2a0f22 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:45.085532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a17e88-7d67-4a54-a906-9b9ddc2a0f22 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:45.085782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a17e88-7d67-4a54-a906-9b9ddc2a0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:45.156381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f2a17e88-7d67-4a54-a906-9b9ddc2a0f22 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:45.157625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f2a17e88-7d67-4a54-a906-9b9ddc2a0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:45.180491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:45.282802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 665/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:45.321085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb976d-a645-4bdb-9efe-a4195fdfb06d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:45.322671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fbcb976d-a645-4bdb-9efe-a4195fdfb06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:45.436738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb976d-a645-4bdb-9efe-a4195fdfb06d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:45.511606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c9cf-e946-408e-8a51-d5834e4a98ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:45.512233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c9cf-e946-408e-8a51-d5834e4a98ce service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:45.512515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c9cf-e946-408e-8a51-d5834e4a98ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:45.512791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c9cf-e946-408e-8a51-d5834e4a98ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:45.514442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a707c9cf-e946-408e-8a51-d5834e4a98ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:45.560538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:45.635210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c9cf-e946-408e-8a51-d5834e4a98ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:45.636558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c9cf-e946-408e-8a51-d5834e4a98ce service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:45.655971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 681/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:49.736193 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6311312-0577-4b14-9f47-1501caff2def None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:49.736772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6311312-0577-4b14-9f47-1501caff2def None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:49.736772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6311312-0577-4b14-9f47-1501caff2def None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:49.738138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 666/1347] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:49.743664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94311f9e-8433-4e7b-ad6f-dbd6e7aabd9c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:49.744110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94311f9e-8433-4e7b-ad6f-dbd6e7aabd9c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:49.744203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94311f9e-8433-4e7b-ad6f-dbd6e7aabd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:49.813886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-94311f9e-8433-4e7b-ad6f-dbd6e7aabd9c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:49.815668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-94311f9e-8433-4e7b-ad6f-dbd6e7aabd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:49.917908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:49.921153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 682/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:49.959133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6311312-0577-4b14-9f47-1501caff2def None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:41:49.960674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f6311312-0577-4b14-9f47-1501caff2def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:50.105341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6311312-0577-4b14-9f47-1501caff2def None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:41:50.163103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:50.191368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b32f5-d8f5-4376-bc2a-b3e35171442b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:41:50.192113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b32f5-d8f5-4376-bc2a-b3e35171442b service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:50.192461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b32f5-d8f5-4376-bc2a-b3e35171442b service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:50.192737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b32f5-d8f5-4376-bc2a-b3e35171442b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:50.194414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fb6b32f5-d8f5-4376-bc2a-b3e35171442b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:50.314075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b32f5-d8f5-4376-bc2a-b3e35171442b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:41:50.316171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b32f5-d8f5-4376-bc2a-b3e35171442b service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:41:50.335042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 667/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:41:55.376410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3ebaa-92d9-42c8-bac8-d522537019e6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:55.377872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3ebaa-92d9-42c8-bac8-d522537019e6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:55.378347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3ebaa-92d9-42c8-bac8-d522537019e6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:55.380230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 683/1350] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:41:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:55.385736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37a7be-dbb5-4bc0-aa9a-aebbb1bafa80 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:55.386171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37a7be-dbb5-4bc0-aa9a-aebbb1bafa80 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:55.386280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37a7be-dbb5-4bc0-aa9a-aebbb1bafa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:55.486263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0d37a7be-dbb5-4bc0-aa9a-aebbb1bafa80 None None] MFA Rules not processed for user `beaec3b392e3468981992629101cf883`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:55.488679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0d37a7be-dbb5-4bc0-aa9a-aebbb1bafa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:55.509442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:55.632403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 668/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:41:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:41:59.652969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecba9a-b8ad-40ed-b467-2a549b4fb7d2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:59.654012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecba9a-b8ad-40ed-b467-2a549b4fb7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:59.654491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecba9a-b8ad-40ed-b467-2a549b4fb7d2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:59.656082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 684/1352] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:41:59.661743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362247c-4f73-4496-a4e7-8251bac8186e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:41:59.662187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362247c-4f73-4496-a4e7-8251bac8186e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:41:59.662269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362247c-4f73-4496-a4e7-8251bac8186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:41:59.741557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0362247c-4f73-4496-a4e7-8251bac8186e None None] MFA Rules not processed for user `beaec3b392e3468981992629101cf883`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:41:59.742689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0362247c-4f73-4496-a4e7-8251bac8186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:41:59.820065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:41:59.863111 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 669/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:41:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:01.388602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0203c-fcaa-4589-99a6-bb1d6089a722 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:01.389203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0203c-fcaa-4589-99a6-bb1d6089a722 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:01.389203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0203c-fcaa-4589-99a6-bb1d6089a722 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:01.390601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 685/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:01.396518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4b52-57c9-49d5-8fab-923cfb0831e1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:01.397012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4b52-57c9-49d5-8fab-923cfb0831e1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:01.397103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4b52-57c9-49d5-8fab-923cfb0831e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:01.483411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-959e4b52-57c9-49d5-8fab-923cfb0831e1 None None] MFA Rules not processed for user `beaec3b392e3468981992629101cf883`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:01.485046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-959e4b52-57c9-49d5-8fab-923cfb0831e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:01.597138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 670/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:42:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:05.011300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7cebb-0087-488d-b5a0-c4e5e9aeba6e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:05.012279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7cebb-0087-488d-b5a0-c4e5e9aeba6e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:05.012761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7cebb-0087-488d-b5a0-c4e5e9aeba6e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:05.018189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 686/1356] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:05.022525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df186f-23f7-49ea-a4d8-d16aa7c042f3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:05.023061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df186f-23f7-49ea-a4d8-d16aa7c042f3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:05.023157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df186f-23f7-49ea-a4d8-d16aa7c042f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:05.073701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:05.109878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-28df186f-23f7-49ea-a4d8-d16aa7c042f3 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:05.111644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-28df186f-23f7-49ea-a4d8-d16aa7c042f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:05.223029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 671/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:05.283225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4b10a-78f5-4826-b42a-294229f2e0f8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:05.284644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4b10a-78f5-4826-b42a-294229f2e0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:05.285279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4b10a-78f5-4826-b42a-294229f2e0f8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:05.287287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 687/1358] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jul 27 07:42:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:05.296045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb23a0-59f5-4926-8bbd-f7f26ee34bc1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:05.296834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb23a0-59f5-4926-8bbd-f7f26ee34bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:05.297354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb23a0-59f5-4926-8bbd-f7f26ee34bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:05.387602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1cfb23a0-59f5-4926-8bbd-f7f26ee34bc1 None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:05.388907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1cfb23a0-59f5-4926-8bbd-f7f26ee34bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:05.448459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:05.519713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 672/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jul 27 07:42:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:42:05.527246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4b10a-78f5-4826-b42a-294229f2e0f8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:05.528765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-89e4b10a-78f5-4826-b42a-294229f2e0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:05.689350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4b10a-78f5-4826-b42a-294229f2e0f8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:05.765333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:05.809046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bf1a7-e01d-4ed7-86e2-c1673184668b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:05.809582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bf1a7-e01d-4ed7-86e2-c1673184668b service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:05.809856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bf1a7-e01d-4ed7-86e2-c1673184668b service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:05.810123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bf1a7-e01d-4ed7-86e2-c1673184668b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:05.811759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-516bf1a7-e01d-4ed7-86e2-c1673184668b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:05.915234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bf1a7-e01d-4ed7-86e2-c1673184668b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:05.916848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bf1a7-e01d-4ed7-86e2-c1673184668b service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:05.935350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 688/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:08.156243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1fe65-0bb4-47c2-9b98-14c6a378959c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:08.156726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1fe65-0bb4-47c2-9b98-14c6a378959c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:08.156820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1fe65-0bb4-47c2-9b98-14c6a378959c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:08.158339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 673/1361] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:08.163633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6415-463c-4513-a910-f0a98b8593cc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:08.164110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6415-463c-4513-a910-f0a98b8593cc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:08.164239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6415-463c-4513-a910-f0a98b8593cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:08.241144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e2ce6415-463c-4513-a910-f0a98b8593cc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:08.242268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e2ce6415-463c-4513-a910-f0a98b8593cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:08.282492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:08.348067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 689/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:08.391485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1fe65-0bb4-47c2-9b98-14c6a378959c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:08.393567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-83e1fe65-0bb4-47c2-9b98-14c6a378959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:08.582207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1fe65-0bb4-47c2-9b98-14c6a378959c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:08.592779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:08.746344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d3f13-6339-4155-8f15-527dd728b4fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:08.747145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d3f13-6339-4155-8f15-527dd728b4fa service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:08.747372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d3f13-6339-4155-8f15-527dd728b4fa service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:08.747639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d3f13-6339-4155-8f15-527dd728b4fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:08.749631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5e6d3f13-6339-4155-8f15-527dd728b4fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:08.851836 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d3f13-6339-4155-8f15-527dd728b4fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:08.853494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d3f13-6339-4155-8f15-527dd728b4fa service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:08.873383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 674/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:11.207876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08765553-e9bd-4e28-8f00-aaadbefc0d08 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:11.208858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08765553-e9bd-4e28-8f00-aaadbefc0d08 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:11.209210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08765553-e9bd-4e28-8f00-aaadbefc0d08 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:11.210627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 690/1364] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:11.216710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac55f-36d4-4bf2-be3b-c6b73a6b7de5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:11.217217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac55f-36d4-4bf2-be3b-c6b73a6b7de5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:11.217342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac55f-36d4-4bf2-be3b-c6b73a6b7de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:11.237576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:11.310394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f2dac55f-36d4-4bf2-be3b-c6b73a6b7de5 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:11.311900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f2dac55f-36d4-4bf2-be3b-c6b73a6b7de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:11.448638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 675/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:11.494953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94182e-e230-4373-a9df-c98d04361aec None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:11.495287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94182e-e230-4373-a9df-c98d04361aec None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:11.495506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94182e-e230-4373-a9df-c98d04361aec None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:11.497057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 691/1366] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jul 27 07:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:11.503680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4af7-0466-4260-a678-54c6b9ca9b9b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:11.504044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4af7-0466-4260-a678-54c6b9ca9b9b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:11.504540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4af7-0466-4260-a678-54c6b9ca9b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:11.592865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-23af4af7-0466-4260-a678-54c6b9ca9b9b None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:11.594754 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-23af4af7-0466-4260-a678-54c6b9ca9b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:11.639025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:11.736461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 676/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jul 27 07:42:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:11.744432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94182e-e230-4373-a9df-c98d04361aec None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:11.746073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1d94182e-e230-4373-a9df-c98d04361aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:11.921478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94182e-e230-4373-a9df-c98d04361aec None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:11.944668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:12.095726 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6ae53-75d3-4e73-9d14-e21d662cba9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:12.096804 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6ae53-75d3-4e73-9d14-e21d662cba9f service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:12.097271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6ae53-75d3-4e73-9d14-e21d662cba9f service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:12.097737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6ae53-75d3-4e73-9d14-e21d662cba9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:12.100984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8ce6ae53-75d3-4e73-9d14-e21d662cba9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:12.221058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6ae53-75d3-4e73-9d14-e21d662cba9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:12.223408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6ae53-75d3-4e73-9d14-e21d662cba9f service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:12.249257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 692/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:13.203247 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff48f3-683a-4139-a516-7ec7f1f3b43f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:13.203807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff48f3-683a-4139-a516-7ec7f1f3b43f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:13.203807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff48f3-683a-4139-a516-7ec7f1f3b43f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:13.205535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 677/1369] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:13.211190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834b9d-bed5-4688-ae77-5978c437f92e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:13.211553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834b9d-bed5-4688-ae77-5978c437f92e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:13.211754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834b9d-bed5-4688-ae77-5978c437f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:13.248753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:13.290238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-50834b9d-bed5-4688-ae77-5978c437f92e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:13.291509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-50834b9d-bed5-4688-ae77-5978c437f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:13.396786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 693/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:13.740973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f223-42fa-4ac1-a0eb-caaf6697afe3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:13.740973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f223-42fa-4ac1-a0eb-caaf6697afe3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:13.740973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f223-42fa-4ac1-a0eb-caaf6697afe3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:13.743300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 678/1371] 10.222.0.18 () {54 vars in 964 bytes} [Wed Jul 27 07:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:13.747262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c4ea3-e709-4935-be09-dd1cbcd7aae8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:13.747436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c4ea3-e709-4935-be09-dd1cbcd7aae8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:13.747639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c4ea3-e709-4935-be09-dd1cbcd7aae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:13.827656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-969c4ea3-e709-4935-be09-dd1cbcd7aae8 None None] MFA Rules not processed for user `ae1eae16b54c46e9a92f423094085b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:13.828895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-969c4ea3-e709-4935-be09-dd1cbcd7aae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:13.882432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:13.913827 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 694/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Jul 27 07:42:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:13.921227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f223-42fa-4ac1-a0eb-caaf6697afe3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:13.922804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5034f223-42fa-4ac1-a0eb-caaf6697afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:14.033584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f223-42fa-4ac1-a0eb-caaf6697afe3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:14.077327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:14.117652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7970c10-3c86-4cf0-b04c-1615f394e996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:14.118198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970c10-3c86-4cf0-b04c-1615f394e996 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:14.118578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970c10-3c86-4cf0-b04c-1615f394e996 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:14.118915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970c10-3c86-4cf0-b04c-1615f394e996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:14.120612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c7970c10-3c86-4cf0-b04c-1615f394e996 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:14.239861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7970c10-3c86-4cf0-b04c-1615f394e996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:14.241323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7970c10-3c86-4cf0-b04c-1615f394e996 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:14.261920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 679/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:14.350537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b97bd-2fec-48f4-8011-5baf89d14ef7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:14.351087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b97bd-2fec-48f4-8011-5baf89d14ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:14.351211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b97bd-2fec-48f4-8011-5baf89d14ef7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:14.353377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 695/1374] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:14.360050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7eec-9f97-400e-9b51-0819f6d006fa None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:14.361109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7eec-9f97-400e-9b51-0819f6d006fa None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:14.361452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7eec-9f97-400e-9b51-0819f6d006fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:14.436071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f77f7eec-9f97-400e-9b51-0819f6d006fa None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:14.437363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f77f7eec-9f97-400e-9b51-0819f6d006fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:14.463981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:14.550129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 680/1375] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:42:14.597142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b97bd-2fec-48f4-8011-5baf89d14ef7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:14.598964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-af3b97bd-2fec-48f4-8011-5baf89d14ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:14.837237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b97bd-2fec-48f4-8011-5baf89d14ef7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:14.893446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:14.959268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a650f-86f4-45ee-90c1-f1305636b309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:14.959943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a650f-86f4-45ee-90c1-f1305636b309 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:14.960236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a650f-86f4-45ee-90c1-f1305636b309 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:14.960512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a650f-86f4-45ee-90c1-f1305636b309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:14.962513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-827a650f-86f4-45ee-90c1-f1305636b309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:15.056379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a650f-86f4-45ee-90c1-f1305636b309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:15.058020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a650f-86f4-45ee-90c1-f1305636b309 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:15.079043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 696/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:17.196716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd7712-b258-49b2-a8df-5f6b7f2a4b31 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:17.197544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd7712-b258-49b2-a8df-5f6b7f2a4b31 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:17.197731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd7712-b258-49b2-a8df-5f6b7f2a4b31 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:17.199356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 681/1377] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:17.205568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689adfd-483a-4d83-aff1-b51c210b4b85 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:17.206016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689adfd-483a-4d83-aff1-b51c210b4b85 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:17.206127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689adfd-483a-4d83-aff1-b51c210b4b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:17.274613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5689adfd-483a-4d83-aff1-b51c210b4b85 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:17.276496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5689adfd-483a-4d83-aff1-b51c210b4b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:17.283969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:17.399698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 697/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:17.443858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd7712-b258-49b2-a8df-5f6b7f2a4b31 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:17.445367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-02fd7712-b258-49b2-a8df-5f6b7f2a4b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:17.597864 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd7712-b258-49b2-a8df-5f6b7f2a4b31 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:17.602062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:17.723051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105958e-60ec-4313-aa0d-25958a9d4956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:17.723683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105958e-60ec-4313-aa0d-25958a9d4956 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:17.724107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105958e-60ec-4313-aa0d-25958a9d4956 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:17.724383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105958e-60ec-4313-aa0d-25958a9d4956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:17.726054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4105958e-60ec-4313-aa0d-25958a9d4956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:17.846514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105958e-60ec-4313-aa0d-25958a9d4956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:17.848269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105958e-60ec-4313-aa0d-25958a9d4956 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:17.868675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 682/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:19.966236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01bbb4-c4b4-4bcd-a862-7a02bb6937b5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:19.966780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01bbb4-c4b4-4bcd-a862-7a02bb6937b5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:19.966780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01bbb4-c4b4-4bcd-a862-7a02bb6937b5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:19.968301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 698/1380] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:19.974149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2667b8-3ed7-4448-9400-8fcd1ab3d49c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:19.974612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2667b8-3ed7-4448-9400-8fcd1ab3d49c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:19.974703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2667b8-3ed7-4448-9400-8fcd1ab3d49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:19.986197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:20.044973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ca2667b8-3ed7-4448-9400-8fcd1ab3d49c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:20.046166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ca2667b8-3ed7-4448-9400-8fcd1ab3d49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:20.152587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 683/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:20.197271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01bbb4-c4b4-4bcd-a862-7a02bb6937b5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:20.199921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dd01bbb4-c4b4-4bcd-a862-7a02bb6937b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:20.351160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:20.363632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01bbb4-c4b4-4bcd-a862-7a02bb6937b5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:20.502298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a7c58-2655-4ead-9454-048e7cb130b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:20.502935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a7c58-2655-4ead-9454-048e7cb130b1 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:20.503221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a7c58-2655-4ead-9454-048e7cb130b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:20.503492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a7c58-2655-4ead-9454-048e7cb130b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:20.505125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7d7a7c58-2655-4ead-9454-048e7cb130b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:20.602768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a7c58-2655-4ead-9454-048e7cb130b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:20.604332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a7c58-2655-4ead-9454-048e7cb130b1 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:20.616130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:20.625371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 699/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:22.698218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df63b0e-5958-4fa2-affc-b9d41338097d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:22.698911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df63b0e-5958-4fa2-affc-b9d41338097d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:22.698911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df63b0e-5958-4fa2-affc-b9d41338097d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:22.700108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 684/1383] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:22.706667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc306bf5-c34c-41f0-b6ca-5591b48ab3ca None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:22.707145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc306bf5-c34c-41f0-b6ca-5591b48ab3ca None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:22.707245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc306bf5-c34c-41f0-b6ca-5591b48ab3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:22.790526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bc306bf5-c34c-41f0-b6ca-5591b48ab3ca None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:22.792203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bc306bf5-c34c-41f0-b6ca-5591b48ab3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:22.896954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 700/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:22.942480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df63b0e-5958-4fa2-affc-b9d41338097d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:22.944145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9df63b0e-5958-4fa2-affc-b9d41338097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:23.039418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:23.103284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df63b0e-5958-4fa2-affc-b9d41338097d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:23.227875 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac96d8-d60d-44fd-92d0-7383cf754a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:23.228520 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac96d8-d60d-44fd-92d0-7383cf754a32 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:23.228830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac96d8-d60d-44fd-92d0-7383cf754a32 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:23.229101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac96d8-d60d-44fd-92d0-7383cf754a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:23.230831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ebac96d8-d60d-44fd-92d0-7383cf754a32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:23.283636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:23.326089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac96d8-d60d-44fd-92d0-7383cf754a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:23.327736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac96d8-d60d-44fd-92d0-7383cf754a32 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:23.348835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 685/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:25.435500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9b887-610b-407d-8c10-ee01e1013fbe None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:25.435982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9b887-610b-407d-8c10-ee01e1013fbe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:25.436104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9b887-610b-407d-8c10-ee01e1013fbe None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:25.437466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 701/1386] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:25.443391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c11402-9863-48d1-8691-03393b0633a3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:25.443850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c11402-9863-48d1-8691-03393b0633a3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:25.443972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c11402-9863-48d1-8691-03393b0633a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:25.513390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d3c11402-9863-48d1-8691-03393b0633a3 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:25.514661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d3c11402-9863-48d1-8691-03393b0633a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:25.617255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 686/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:25.660381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9b887-610b-407d-8c10-ee01e1013fbe None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:25.661903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2ba9b887-610b-407d-8c10-ee01e1013fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:25.754633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:25.831071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9b887-610b-407d-8c10-ee01e1013fbe None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:25.956313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709d3f3-fe78-44b5-94e2-40efc804fa3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:25.956934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709d3f3-fe78-44b5-94e2-40efc804fa3f service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:25.957206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709d3f3-fe78-44b5-94e2-40efc804fa3f service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:25.957474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709d3f3-fe78-44b5-94e2-40efc804fa3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:25.959140 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0709d3f3-fe78-44b5-94e2-40efc804fa3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:25.998444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:26.052361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709d3f3-fe78-44b5-94e2-40efc804fa3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:26.053984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709d3f3-fe78-44b5-94e2-40efc804fa3f service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:26.073669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 702/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:28.323785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde91067-8609-4dba-8ffc-3965ab3ba35a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:28.324338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde91067-8609-4dba-8ffc-3965ab3ba35a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:28.324338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde91067-8609-4dba-8ffc-3965ab3ba35a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:28.325688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 687/1389] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:28.330871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c3a1-3e06-4dd7-95bd-7fcc72e8b12b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:28.331418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c3a1-3e06-4dd7-95bd-7fcc72e8b12b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:28.331512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c3a1-3e06-4dd7-95bd-7fcc72e8b12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:28.400707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fd91c3a1-3e06-4dd7-95bd-7fcc72e8b12b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:28.401909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fd91c3a1-3e06-4dd7-95bd-7fcc72e8b12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:28.507681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 703/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:28.553169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde91067-8609-4dba-8ffc-3965ab3ba35a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:28.554734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fde91067-8609-4dba-8ffc-3965ab3ba35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:28.587636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:28.703913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde91067-8609-4dba-8ffc-3965ab3ba35a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:28.814794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:28.828030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c0217-e8cc-4c38-a796-f1fa5ecd6742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:28.829354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c0217-e8cc-4c38-a796-f1fa5ecd6742 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:28.829855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c0217-e8cc-4c38-a796-f1fa5ecd6742 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:28.830353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c0217-e8cc-4c38-a796-f1fa5ecd6742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:28.832815 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4c3c0217-e8cc-4c38-a796-f1fa5ecd6742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:28.925881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c0217-e8cc-4c38-a796-f1fa5ecd6742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:28.927522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c0217-e8cc-4c38-a796-f1fa5ecd6742 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:28.946177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 688/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:29.471493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce839d1d-93cd-4542-af05-cd09cf7580c1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:29.472023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce839d1d-93cd-4542-af05-cd09cf7580c1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:29.472023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce839d1d-93cd-4542-af05-cd09cf7580c1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:29.473430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 704/1392] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:29.478944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498736d7-67b3-41c1-a940-4e82b9a0b08f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:29.479371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498736d7-67b3-41c1-a940-4e82b9a0b08f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:29.479509 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498736d7-67b3-41c1-a940-4e82b9a0b08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:29.549638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-498736d7-67b3-41c1-a940-4e82b9a0b08f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:29.550856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-498736d7-67b3-41c1-a940-4e82b9a0b08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:29.612166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:29.652179 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 689/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:29.708107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1560e-c39c-4272-a08f-977aec06e30e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:29.708499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1560e-c39c-4272-a08f-977aec06e30e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:29.708946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1560e-c39c-4272-a08f-977aec06e30e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:29.710411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 705/1394] 10.222.0.18 () {54 vars in 966 bytes} [Wed Jul 27 07:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:29.715897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b5486-331a-4af1-b8b5-a89b1746df25 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:29.716219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b5486-331a-4af1-b8b5-a89b1746df25 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:29.716494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b5486-331a-4af1-b8b5-a89b1746df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:29.793355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-496b5486-331a-4af1-b8b5-a89b1746df25 None None] MFA Rules not processed for user `ad7a3c5f6b9645fb8cd2a65cee4f37c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:29.794660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-496b5486-331a-4af1-b8b5-a89b1746df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:29.872629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 690/1395] 10.222.0.18 () {58 vars in 1063 bytes} [Wed Jul 27 07:42:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:29.880261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1560e-c39c-4272-a08f-977aec06e30e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:29.881803 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e0c1560e-c39c-4272-a08f-977aec06e30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:29.898673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:29.994221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1560e-c39c-4272-a08f-977aec06e30e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:30.067951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999abe7-7fa5-4556-acd8-a591efb15bf6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7a3c5f6b9645fb8cd2a65cee4f37c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:30.068590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999abe7-7fa5-4556-acd8-a591efb15bf6 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:30.068877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999abe7-7fa5-4556-acd8-a591efb15bf6 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:30.069151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999abe7-7fa5-4556-acd8-a591efb15bf6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:30.070791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2999abe7-7fa5-4556-acd8-a591efb15bf6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:30.143623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:30.190990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999abe7-7fa5-4556-acd8-a591efb15bf6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:30.192430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999abe7-7fa5-4556-acd8-a591efb15bf6 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:30.210446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 706/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:30.947389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e776d-0d7e-4a8c-9421-685d44f514a4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:30.947883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e776d-0d7e-4a8c-9421-685d44f514a4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:30.947883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e776d-0d7e-4a8c-9421-685d44f514a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:31.002676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b0098-5cfc-433f-a1fa-c1d5d8d6d0a0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:31.003271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b0098-5cfc-433f-a1fa-c1d5d8d6d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:31.003271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b0098-5cfc-433f-a1fa-c1d5d8d6d0a0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:31.004629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 707/1397] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:31.009487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619408-d46d-4dd1-a2c7-6219d3b4c96e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:31.009773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619408-d46d-4dd1-a2c7-6219d3b4c96e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:31.010045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619408-d46d-4dd1-a2c7-6219d3b4c96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:31.015670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-796e776d-0d7e-4a8c-9421-685d44f514a4 None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:31.017483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-796e776d-0d7e-4a8c-9421-685d44f514a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:31.026350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:31.082056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-eb619408-d46d-4dd1-a2c7-6219d3b4c96e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:31.083339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-eb619408-d46d-4dd1-a2c7-6219d3b4c96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:31.108348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 691/1398] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:42:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:31.167669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cd986-7ec6-480e-8fad-8028c6650791 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:31.167978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cd986-7ec6-480e-8fad-8028c6650791 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:31.168249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cd986-7ec6-480e-8fad-8028c6650791 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:31.169596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 692/1399] 10.222.0.18 () {54 vars in 943 bytes} [Wed Jul 27 07:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:42:31.176588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3517-eccf-4bf0-b737-79d60af887d1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:31.176947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3517-eccf-4bf0-b737-79d60af887d1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:31.177229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3517-eccf-4bf0-b737-79d60af887d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:31.209596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 708/1400] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:42:31.256225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619408-d46d-4dd1-a2c7-6219d3b4c96e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:31.257453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-eb619408-d46d-4dd1-a2c7-6219d3b4c96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:31.269729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-03ed3517-eccf-4bf0-b737-79d60af887d1 None None] MFA Rules not processed for user `b5bb94b71d1c452a88f1594a6b011ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:31.270968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-03ed3517-eccf-4bf0-b737-79d60af887d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:31.285909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:31.357834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:31.378119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619408-d46d-4dd1-a2c7-6219d3b4c96e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:31.394365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 693/1401] 10.222.0.18 () {58 vars in 1040 bytes} [Wed Jul 27 07:42:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:42:31.404211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed3517-eccf-4bf0-b737-79d60af887d1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:31.414437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed3517-eccf-4bf0-b737-79d60af887d1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:31.517600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dab7b5-afce-4e09-a74d-475458a50cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:31.518126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dab7b5-afce-4e09-a74d-475458a50cf2 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:31.518405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dab7b5-afce-4e09-a74d-475458a50cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:31.518680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dab7b5-afce-4e09-a74d-475458a50cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:31.520367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-14dab7b5-afce-4e09-a74d-475458a50cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:31.530416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4a1a1-b392-4dbb-a7d7-5653f700dd30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:31.531076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a1a1-b392-4dbb-a7d7-5653f700dd30 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:31.531448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a1a1-b392-4dbb-a7d7-5653f700dd30 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:31.531720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a1a1-b392-4dbb-a7d7-5653f700dd30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:31.533397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-56b4a1a1-b392-4dbb-a7d7-5653f700dd30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:31.538743 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:31.612414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dab7b5-afce-4e09-a74d-475458a50cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:31.614058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dab7b5-afce-4e09-a74d-475458a50cf2 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:31.618153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4a1a1-b392-4dbb-a7d7-5653f700dd30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:31.619776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4a1a1-b392-4dbb-a7d7-5653f700dd30 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:31.628417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 694/1402] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:42:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 07:42:31.633720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 709/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:42:33.761458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad28b76-9d09-47f6-8189-380b76976b9d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:33.761999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad28b76-9d09-47f6-8189-380b76976b9d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:33.761999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad28b76-9d09-47f6-8189-380b76976b9d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:33.763399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 695/1404] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:33.770434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd84647-203d-43ab-a2a6-c67e2e197c4e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:33.770434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd84647-203d-43ab-a2a6-c67e2e197c4e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:33.770434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd84647-203d-43ab-a2a6-c67e2e197c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:33.841265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2dd84647-203d-43ab-a2a6-c67e2e197c4e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:33.845491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2dd84647-203d-43ab-a2a6-c67e2e197c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:33.961713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:33.975035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 710/1405] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:34.017909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad28b76-9d09-47f6-8189-380b76976b9d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:34.019432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0ad28b76-9d09-47f6-8189-380b76976b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:34.029642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:34.255420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad28b76-9d09-47f6-8189-380b76976b9d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:34.356300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:34.398364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12b2fa-6404-4cb4-8eea-ebf5bb46a265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:34.398364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12b2fa-6404-4cb4-8eea-ebf5bb46a265 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:34.398364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12b2fa-6404-4cb4-8eea-ebf5bb46a265 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:34.398776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12b2fa-6404-4cb4-8eea-ebf5bb46a265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:34.400298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bc12b2fa-6404-4cb4-8eea-ebf5bb46a265 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:34.508322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12b2fa-6404-4cb4-8eea-ebf5bb46a265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:34.509949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12b2fa-6404-4cb4-8eea-ebf5bb46a265 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:34.528765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 696/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:36.606349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e812971-372d-4d41-97ee-c8098f8b2de2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:36.607102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e812971-372d-4d41-97ee-c8098f8b2de2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:36.607102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e812971-372d-4d41-97ee-c8098f8b2de2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:36.610914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 711/1407] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:36.614078 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a11d6-c33b-42d3-83b0-ceee6f2f17c0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:36.614532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a11d6-c33b-42d3-83b0-ceee6f2f17c0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:36.614643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a11d6-c33b-42d3-83b0-ceee6f2f17c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:36.687308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b49a11d6-c33b-42d3-83b0-ceee6f2f17c0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:36.689063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b49a11d6-c33b-42d3-83b0-ceee6f2f17c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:36.745147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:36.803187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 697/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:42:36.847685 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e812971-372d-4d41-97ee-c8098f8b2de2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:36.849263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2e812971-372d-4d41-97ee-c8098f8b2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:37.029389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e812971-372d-4d41-97ee-c8098f8b2de2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:37.105603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:37.176040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaaf07-4e64-43f5-91e1-74b2414832ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:37.176690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaaf07-4e64-43f5-91e1-74b2414832ba service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:37.176999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaaf07-4e64-43f5-91e1-74b2414832ba service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:37.177523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaaf07-4e64-43f5-91e1-74b2414832ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:37.179265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9ebaaf07-4e64-43f5-91e1-74b2414832ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:37.288238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaaf07-4e64-43f5-91e1-74b2414832ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:37.289882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaaf07-4e64-43f5-91e1-74b2414832ba service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:37.311975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 712/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:46.801085 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=23 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:47.309609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=64 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:54.118802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72fa6a-0ae3-408c-b9b6-e002ae5d653e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:54.119402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72fa6a-0ae3-408c-b9b6-e002ae5d653e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:54.119402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72fa6a-0ae3-408c-b9b6-e002ae5d653e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:54.120730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 698/1410] 10.222.0.18 () {54 vars in 918 bytes} [Wed Jul 27 07:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:54.125957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f21d1-dd4d-4bf6-b283-cdc5cd793b71 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:54.126396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f21d1-dd4d-4bf6-b283-cdc5cd793b71 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:54.126536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f21d1-dd4d-4bf6-b283-cdc5cd793b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:54.203134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-401f21d1-dd4d-4bf6-b283-cdc5cd793b71 None None] MFA Rules not processed for user `beaec3b392e3468981992629101cf883`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:54.204350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-401f21d1-dd4d-4bf6-b283-cdc5cd793b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:54.312402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 713/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Jul 27 07:42:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:54.326771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92470-f159-4ea7-b2c2-ae0f42e635c4 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:54.327707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92470-f159-4ea7-b2c2-ae0f42e635c4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:54.328024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92470-f159-4ea7-b2c2-ae0f42e635c4 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:54.329352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 699/1412] 10.222.0.18 () {54 vars in 918 bytes} [Wed Jul 27 07:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:54.334080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496130-55cb-4d9c-8da2-a65fb36ebbab None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:54.334370 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496130-55cb-4d9c-8da2-a65fb36ebbab None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:54.334650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496130-55cb-4d9c-8da2-a65fb36ebbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:54.408665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:54.412089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-df496130-55cb-4d9c-8da2-a65fb36ebbab None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:54.413488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-df496130-55cb-4d9c-8da2-a65fb36ebbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:54.533083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 714/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Jul 27 07:42:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:42:57.028089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525b502-8763-4cbe-9980-8194a7a67b67 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:57.028643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525b502-8763-4cbe-9980-8194a7a67b67 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:57.028643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525b502-8763-4cbe-9980-8194a7a67b67 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:57.029986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:42:57.036005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578a033-e6d4-46b5-bcd2-13b37dfad627 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:57.036454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578a033-e6d4-46b5-bcd2-13b37dfad627 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:57.036560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578a033-e6d4-46b5-bcd2-13b37dfad627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:57.102783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0578a033-e6d4-46b5-bcd2-13b37dfad627 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:57.104375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0578a033-e6d4-46b5-bcd2-13b37dfad627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:57.160305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:57.203401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:57.252233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525b502-8763-4cbe-9980-8194a7a67b67 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:57.253824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0525b502-8763-4cbe-9980-8194a7a67b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:57.399268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525b502-8763-4cbe-9980-8194a7a67b67 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:57.473601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:57.515736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96114ec1-27d8-49e7-87cc-32aa36fda3d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:57.516354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96114ec1-27d8-49e7-87cc-32aa36fda3d6 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:57.516635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96114ec1-27d8-49e7-87cc-32aa36fda3d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:57.516906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96114ec1-27d8-49e7-87cc-32aa36fda3d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:57.518544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-96114ec1-27d8-49e7-87cc-32aa36fda3d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:57.728830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96114ec1-27d8-49e7-87cc-32aa36fda3d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:57.730345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96114ec1-27d8-49e7-87cc-32aa36fda3d6 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:57.748329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 701/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:58.710437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13da694-825d-4060-ab0f-ab7c58adc4fb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:58.710991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13da694-825d-4060-ab0f-ab7c58adc4fb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:58.710991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13da694-825d-4060-ab0f-ab7c58adc4fb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:58.712322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:42:58.717177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03650ba-69f2-4fdc-87e8-868493744ee0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:58.717670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03650ba-69f2-4fdc-87e8-868493744ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:58.717774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03650ba-69f2-4fdc-87e8-868493744ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:58.793812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a03650ba-69f2-4fdc-87e8-868493744ee0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:42:58.795066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a03650ba-69f2-4fdc-87e8-868493744ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:58.822453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:58.893780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:42:59.044574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13da694-825d-4060-ab0f-ab7c58adc4fb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:42:59.046020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e13da694-825d-4060-ab0f-ab7c58adc4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:59.193519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13da694-825d-4060-ab0f-ab7c58adc4fb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:42:59.234453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:59.308354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db52519-6433-4c60-9cf1-c9674f622bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:42:59.308875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52519-6433-4c60-9cf1-c9674f622bfa service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:42:59.309147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52519-6433-4c60-9cf1-c9674f622bfa service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:42:59.309414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52519-6433-4c60-9cf1-c9674f622bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:42:59.311068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0db52519-6433-4c60-9cf1-c9674f622bfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:42:59.403063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db52519-6433-4c60-9cf1-c9674f622bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:42:59.404664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db52519-6433-4c60-9cf1-c9674f622bfa service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:42:59.423744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 717/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:00.313379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721644-feab-45aa-af30-07b6f2dac2ab None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:00.314055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721644-feab-45aa-af30-07b6f2dac2ab None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:00.314055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721644-feab-45aa-af30-07b6f2dac2ab None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:00.315287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:00.320136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d7ed8-56b6-4966-a8c1-08017f0fa0a7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:00.320606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d7ed8-56b6-4966-a8c1-08017f0fa0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:00.320707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d7ed8-56b6-4966-a8c1-08017f0fa0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:00.375958 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:00.398893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-788d7ed8-56b6-4966-a8c1-08017f0fa0a7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:00.400133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-788d7ed8-56b6-4966-a8c1-08017f0fa0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:00.497368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:00.651263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721644-feab-45aa-af30-07b6f2dac2ab None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:00.652797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-20721644-feab-45aa-af30-07b6f2dac2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:00.796684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721644-feab-45aa-af30-07b6f2dac2ab None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:00.809079 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:00.914008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880f9b0-c103-4314-848e-bf59ec5e9b81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:00.914628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f9b0-c103-4314-848e-bf59ec5e9b81 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:00.914921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f9b0-c103-4314-848e-bf59ec5e9b81 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:00.915194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f9b0-c103-4314-848e-bf59ec5e9b81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:00.916820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3880f9b0-c103-4314-848e-bf59ec5e9b81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:01.005806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880f9b0-c103-4314-848e-bf59ec5e9b81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:01.007428 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880f9b0-c103-4314-848e-bf59ec5e9b81 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:01.024923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 704/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:01.889868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24620cce-6414-485b-af25-4477a655b932 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:01.890444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24620cce-6414-485b-af25-4477a655b932 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:01.890900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24620cce-6414-485b-af25-4477a655b932 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:01.892980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:01.898643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090499dd-a843-4fb0-93af-20cc27428566 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:01.899313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090499dd-a843-4fb0-93af-20cc27428566 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:01.899313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090499dd-a843-4fb0-93af-20cc27428566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:01.920127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:01.981624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-090499dd-a843-4fb0-93af-20cc27428566 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:01.982917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-090499dd-a843-4fb0-93af-20cc27428566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:02.082541 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:02.239661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24620cce-6414-485b-af25-4477a655b932 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:02.241118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-24620cce-6414-485b-af25-4477a655b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:02.352395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:02.390028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24620cce-6414-485b-af25-4477a655b932 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:02.505833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de41531-29fb-499a-b2a7-4ee4c0fc0f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:02.506457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de41531-29fb-499a-b2a7-4ee4c0fc0f66 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:02.506739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de41531-29fb-499a-b2a7-4ee4c0fc0f66 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:02.507045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de41531-29fb-499a-b2a7-4ee4c0fc0f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:02.508672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0de41531-29fb-499a-b2a7-4ee4c0fc0f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:02.593945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:02.609278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de41531-29fb-499a-b2a7-4ee4c0fc0f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:02.610989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de41531-29fb-499a-b2a7-4ee4c0fc0f66 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:02.629087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 720/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:03.502908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38c47-f854-42ec-a8bc-9fb593e3c291 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:03.503483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38c47-f854-42ec-a8bc-9fb593e3c291 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:03.503483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38c47-f854-42ec-a8bc-9fb593e3c291 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:03.505104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:03.509967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01885b6b-2b74-4ee0-9933-4ee00f705dc7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:03.510403 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01885b6b-2b74-4ee0-9933-4ee00f705dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:03.510512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01885b6b-2b74-4ee0-9933-4ee00f705dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:03.585141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-01885b6b-2b74-4ee0-9933-4ee00f705dc7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:03.586358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-01885b6b-2b74-4ee0-9933-4ee00f705dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:03.682101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:03.832262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed38c47-f854-42ec-a8bc-9fb593e3c291 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:03.833797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fed38c47-f854-42ec-a8bc-9fb593e3c291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:03.918598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:03.979455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed38c47-f854-42ec-a8bc-9fb593e3c291 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:04.091495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29162730-f0fe-449f-8f7d-c11379839976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:04.092113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162730-f0fe-449f-8f7d-c11379839976 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:04.092548 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162730-f0fe-449f-8f7d-c11379839976 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:04.092818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162730-f0fe-449f-8f7d-c11379839976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:04.094708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-29162730-f0fe-449f-8f7d-c11379839976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:04.143284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:04.183052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29162730-f0fe-449f-8f7d-c11379839976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:04.184649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29162730-f0fe-449f-8f7d-c11379839976 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:04.203388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 707/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:05.039733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ed14-339e-4616-8da0-e04dcb4b0010 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:05.040406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ed14-339e-4616-8da0-e04dcb4b0010 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:05.040406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ed14-339e-4616-8da0-e04dcb4b0010 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:05.041637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:05.046685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d351a4c-d348-4fe1-89c4-c0144d086106 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:05.047161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d351a4c-d348-4fe1-89c4-c0144d086106 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:05.047272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d351a4c-d348-4fe1-89c4-c0144d086106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:05.122344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5d351a4c-d348-4fe1-89c4-c0144d086106 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:05.124115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5d351a4c-d348-4fe1-89c4-c0144d086106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:05.219861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:05.371480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57ed14-339e-4616-8da0-e04dcb4b0010 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:05.372993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3b57ed14-339e-4616-8da0-e04dcb4b0010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:05.424548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:05.530907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57ed14-339e-4616-8da0-e04dcb4b0010 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:05.645737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70e1df-8376-4795-955f-ed58be7c27dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:05.646243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e1df-8376-4795-955f-ed58be7c27dd service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:05.646524 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e1df-8376-4795-955f-ed58be7c27dd service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:05.646798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e1df-8376-4795-955f-ed58be7c27dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:05.648491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cd70e1df-8376-4795-955f-ed58be7c27dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:05.655519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:05.857678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70e1df-8376-4795-955f-ed58be7c27dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:05.859349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70e1df-8376-4795-955f-ed58be7c27dd service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:05.877725 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 723/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:06.715534 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb839dac-91bc-45ba-9ead-2ed0322f46fb None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:06.716088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb839dac-91bc-45ba-9ead-2ed0322f46fb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:06.716088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb839dac-91bc-45ba-9ead-2ed0322f46fb None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:06.717327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:06.722489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ed5df-92fe-4f32-8465-78300f7d24cb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:06.722934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ed5df-92fe-4f32-8465-78300f7d24cb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:06.723051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ed5df-92fe-4f32-8465-78300f7d24cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:06.797639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-613ed5df-92fe-4f32-8465-78300f7d24cb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:06.798861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-613ed5df-92fe-4f32-8465-78300f7d24cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:06.865735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:06.895556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:07.058291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb839dac-91bc-45ba-9ead-2ed0322f46fb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:07.059743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fb839dac-91bc-45ba-9ead-2ed0322f46fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:07.077578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:07.206390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb839dac-91bc-45ba-9ead-2ed0322f46fb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:07.296658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:07.323282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed7427-a03b-4dca-b14e-a66a856761fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:07.323896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7427-a03b-4dca-b14e-a66a856761fa service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:07.324175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7427-a03b-4dca-b14e-a66a856761fa service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:07.324443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7427-a03b-4dca-b14e-a66a856761fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:07.326063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4aed7427-a03b-4dca-b14e-a66a856761fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:07.416234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed7427-a03b-4dca-b14e-a66a856761fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:07.417834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed7427-a03b-4dca-b14e-a66a856761fa service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:07.440535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 710/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:08.250310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec8d2a-d876-46e1-853c-baa6495f5a60 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:08.250918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec8d2a-d876-46e1-853c-baa6495f5a60 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:08.250918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec8d2a-d876-46e1-853c-baa6495f5a60 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:08.252289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:08.257352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61014231-b23f-421f-9ece-7130d5b6963e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:08.257796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61014231-b23f-421f-9ece-7130d5b6963e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:08.257891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61014231-b23f-421f-9ece-7130d5b6963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:08.333491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-61014231-b23f-421f-9ece-7130d5b6963e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:08.334718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-61014231-b23f-421f-9ece-7130d5b6963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:08.376820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:08.432364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:08.584033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec8d2a-d876-46e1-853c-baa6495f5a60 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:08.585549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c7ec8d2a-d876-46e1-853c-baa6495f5a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:08.729329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec8d2a-d876-46e1-853c-baa6495f5a60 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:08.784186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:08.843513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2894f-0faa-4dfa-b7ad-6d78bd7e2507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:08.844035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2894f-0faa-4dfa-b7ad-6d78bd7e2507 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:08.844306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2894f-0faa-4dfa-b7ad-6d78bd7e2507 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:08.844574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2894f-0faa-4dfa-b7ad-6d78bd7e2507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:08.846176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d1e2894f-0faa-4dfa-b7ad-6d78bd7e2507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:08.933105 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2894f-0faa-4dfa-b7ad-6d78bd7e2507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:08.934686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2894f-0faa-4dfa-b7ad-6d78bd7e2507 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:08.952766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 726/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:09.766023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c861c6-0951-41d1-b38e-5e5c0099f5fe None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:09.766532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c861c6-0951-41d1-b38e-5e5c0099f5fe None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:09.766636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c861c6-0951-41d1-b38e-5e5c0099f5fe None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:09.767993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:09.773465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf98028-c096-4663-8d6e-25451e1ea17c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:09.773928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf98028-c096-4663-8d6e-25451e1ea17c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:09.774043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf98028-c096-4663-8d6e-25451e1ea17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:09.849875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-abf98028-c096-4663-8d6e-25451e1ea17c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:09.851127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-abf98028-c096-4663-8d6e-25451e1ea17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:09.853171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:09.950794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:10.099146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c861c6-0951-41d1-b38e-5e5c0099f5fe None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:10.100700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1c861c6-0951-41d1-b38e-5e5c0099f5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:10.249154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c861c6-0951-41d1-b38e-5e5c0099f5fe None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:10.276979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:10.363592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee80ac7-8786-47f4-a455-825fe44a85d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:10.364126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee80ac7-8786-47f4-a455-825fe44a85d5 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:10.364409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee80ac7-8786-47f4-a455-825fe44a85d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:10.364681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee80ac7-8786-47f4-a455-825fe44a85d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:10.366312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9ee80ac7-8786-47f4-a455-825fe44a85d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:10.455522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee80ac7-8786-47f4-a455-825fe44a85d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:10.457115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee80ac7-8786-47f4-a455-825fe44a85d5 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:10.475178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 713/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:43:12.415900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d333979-86c8-4f22-b05f-58b12e6be560 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:12.416787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d333979-86c8-4f22-b05f-58b12e6be560 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:12.416787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d333979-86c8-4f22-b05f-58b12e6be560 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:12.418426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:12.424247 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b030d-c4af-4a29-95a0-0ba153bc0d20 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:12.425095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b030d-c4af-4a29-95a0-0ba153bc0d20 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:12.425639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b030d-c4af-4a29-95a0-0ba153bc0d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:12.468939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:12.496494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-669b030d-c4af-4a29-95a0-0ba153bc0d20 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:12.498316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-669b030d-c4af-4a29-95a0-0ba153bc0d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:12.599830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:12.638188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d333979-86c8-4f22-b05f-58b12e6be560 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:12.640299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1d333979-86c8-4f22-b05f-58b12e6be560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:12.745605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d333979-86c8-4f22-b05f-58b12e6be560 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:12.779237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:12.821561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46594961-8944-4238-bfdd-05a13c291d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:12.822175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46594961-8944-4238-bfdd-05a13c291d32 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:12.822449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46594961-8944-4238-bfdd-05a13c291d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:12.822715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46594961-8944-4238-bfdd-05a13c291d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:12.824387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-46594961-8944-4238-bfdd-05a13c291d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:12.940491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46594961-8944-4238-bfdd-05a13c291d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:12.941948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46594961-8944-4238-bfdd-05a13c291d32 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:12.960457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 729/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:15.160302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c5e3f-c6a7-4b27-a488-e6053784e8ba None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:15.160878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c5e3f-c6a7-4b27-a488-e6053784e8ba None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:15.160878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c5e3f-c6a7-4b27-a488-e6053784e8ba None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:15.162224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:15.167419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf61a-5830-41be-9afe-0d46c200d880 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:15.167873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf61a-5830-41be-9afe-0d46c200d880 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:15.167977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf61a-5830-41be-9afe-0d46c200d880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:15.234709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e9bcf61a-5830-41be-9afe-0d46c200d880 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:15.236490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e9bcf61a-5830-41be-9afe-0d46c200d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:15.250930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:15.334176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:15.373769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c5e3f-c6a7-4b27-a488-e6053784e8ba None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:15.375758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d65c5e3f-c6a7-4b27-a488-e6053784e8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:15.488966 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c5e3f-c6a7-4b27-a488-e6053784e8ba None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:15.502132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:15.568194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e060750-759d-4c38-b022-f9ebc65568e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:15.568807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060750-759d-4c38-b022-f9ebc65568e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:15.569081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060750-759d-4c38-b022-f9ebc65568e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:15.569348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060750-759d-4c38-b022-f9ebc65568e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:15.570998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7e060750-759d-4c38-b022-f9ebc65568e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:15.679052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e060750-759d-4c38-b022-f9ebc65568e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:15.680402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e060750-759d-4c38-b022-f9ebc65568e6 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:15.697779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 716/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:18.157785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084b9b-b8af-4b70-aaaa-d788ba7ae227 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:18.158385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084b9b-b8af-4b70-aaaa-d788ba7ae227 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:18.158385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084b9b-b8af-4b70-aaaa-d788ba7ae227 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:18.160013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:18.165774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aa128-a113-4af3-99f6-d26fcb61befa None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:18.166250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aa128-a113-4af3-99f6-d26fcb61befa None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:18.166421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aa128-a113-4af3-99f6-d26fcb61befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:18.215230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:18.235501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5b5aa128-a113-4af3-99f6-d26fcb61befa None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:18.236726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5b5aa128-a113-4af3-99f6-d26fcb61befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:18.339138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:18.379604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084b9b-b8af-4b70-aaaa-d788ba7ae227 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:18.381141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2e084b9b-b8af-4b70-aaaa-d788ba7ae227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:18.490636 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084b9b-b8af-4b70-aaaa-d788ba7ae227 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:18.535365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:18.570048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d47e9-19ec-48af-aa0b-b1938afc8c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:18.570661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d47e9-19ec-48af-aa0b-b1938afc8c6b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:18.570971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d47e9-19ec-48af-aa0b-b1938afc8c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:18.571245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d47e9-19ec-48af-aa0b-b1938afc8c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:18.572884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d2d47e9-19ec-48af-aa0b-b1938afc8c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:18.692708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d47e9-19ec-48af-aa0b-b1938afc8c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:18.694042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d47e9-19ec-48af-aa0b-b1938afc8c6b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:18.711992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 732/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:20.834837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b2553-cd40-46e2-b64a-d2fa28a1f300 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:20.835447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b2553-cd40-46e2-b64a-d2fa28a1f300 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:20.835447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b2553-cd40-46e2-b64a-d2fa28a1f300 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:20.836785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:20.842010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf86eb2-37a2-45b3-bef7-da3ecde027b3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:20.842933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf86eb2-37a2-45b3-bef7-da3ecde027b3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:20.843133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf86eb2-37a2-45b3-bef7-da3ecde027b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:20.911963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cdf86eb2-37a2-45b3-bef7-da3ecde027b3 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:20.913184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cdf86eb2-37a2-45b3-bef7-da3ecde027b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:20.933369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:21.008680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:21.047853 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b2553-cd40-46e2-b64a-d2fa28a1f300 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:21.049399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e62b2553-cd40-46e2-b64a-d2fa28a1f300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:21.159754 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b2553-cd40-46e2-b64a-d2fa28a1f300 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:21.180301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:21.237698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf327c99-5a0d-4e6a-870e-0ca5d7f3ab66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:21.238316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf327c99-5a0d-4e6a-870e-0ca5d7f3ab66 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:21.238589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf327c99-5a0d-4e6a-870e-0ca5d7f3ab66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:21.238854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf327c99-5a0d-4e6a-870e-0ca5d7f3ab66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:21.240515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cf327c99-5a0d-4e6a-870e-0ca5d7f3ab66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:21.351983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf327c99-5a0d-4e6a-870e-0ca5d7f3ab66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:21.353433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf327c99-5a0d-4e6a-870e-0ca5d7f3ab66 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:21.371399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 719/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:23.519171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62a507-622e-4fb4-ae2f-7bca7c949a26 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:23.519715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62a507-622e-4fb4-ae2f-7bca7c949a26 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:23.519832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62a507-622e-4fb4-ae2f-7bca7c949a26 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:23.521235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:23.526623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba4f35-d71b-466b-93b1-33a8ac21d589 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:23.527067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba4f35-d71b-466b-93b1-33a8ac21d589 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:23.527227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba4f35-d71b-466b-93b1-33a8ac21d589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:23.593313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:23.596332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-60ba4f35-d71b-466b-93b1-33a8ac21d589 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:23.598208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-60ba4f35-d71b-466b-93b1-33a8ac21d589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:23.702552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:23.742741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62a507-622e-4fb4-ae2f-7bca7c949a26 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:23.744450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5d62a507-622e-4fb4-ae2f-7bca7c949a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:23.852947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62a507-622e-4fb4-ae2f-7bca7c949a26 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:23.902495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:23.927848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137041a-7ece-4a65-98d2-92b133d9793b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:23.928459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137041a-7ece-4a65-98d2-92b133d9793b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:23.928738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137041a-7ece-4a65-98d2-92b133d9793b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:23.929014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137041a-7ece-4a65-98d2-92b133d9793b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:23.930654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1137041a-7ece-4a65-98d2-92b133d9793b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:24.039746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137041a-7ece-4a65-98d2-92b133d9793b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:24.041113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137041a-7ece-4a65-98d2-92b133d9793b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:24.059167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 735/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:26.168291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452ba01-29fa-450c-9070-22e100b20e6e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:26.168859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452ba01-29fa-450c-9070-22e100b20e6e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:26.168859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452ba01-29fa-450c-9070-22e100b20e6e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:26.170194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:26.176236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aac15c-033f-4c51-b4ad-10a08e8f8e73 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:26.176660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aac15c-033f-4c51-b4ad-10a08e8f8e73 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:26.176781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aac15c-033f-4c51-b4ad-10a08e8f8e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:26.244984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-72aac15c-033f-4c51-b4ad-10a08e8f8e73 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:26.246213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-72aac15c-033f-4c51-b4ad-10a08e8f8e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:26.274833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:26.341844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:26.380771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452ba01-29fa-450c-9070-22e100b20e6e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:26.382376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2452ba01-29fa-450c-9070-22e100b20e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:26.491874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452ba01-29fa-450c-9070-22e100b20e6e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:26.525048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:26.571690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238c5b4-5ebb-4912-8208-e888689f090c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:26.572308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238c5b4-5ebb-4912-8208-e888689f090c service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:26.572583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238c5b4-5ebb-4912-8208-e888689f090c service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:26.572851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238c5b4-5ebb-4912-8208-e888689f090c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:26.574461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2238c5b4-5ebb-4912-8208-e888689f090c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:26.683360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238c5b4-5ebb-4912-8208-e888689f090c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:26.684709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238c5b4-5ebb-4912-8208-e888689f090c service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:26.702465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 722/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:28.766040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185d5c0-2408-46b8-9ef5-0687b6ed354a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:28.766572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185d5c0-2408-46b8-9ef5-0687b6ed354a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:28.766572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185d5c0-2408-46b8-9ef5-0687b6ed354a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:28.768129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:28.773223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591dec-3da7-4aff-b672-394d1e7fcfff None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:28.773633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591dec-3da7-4aff-b672-394d1e7fcfff None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:28.773767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591dec-3da7-4aff-b672-394d1e7fcfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:28.839804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-40591dec-3da7-4aff-b672-394d1e7fcfff None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:28.841021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-40591dec-3da7-4aff-b672-394d1e7fcfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:28.849490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:28.937021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:28.974660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185d5c0-2408-46b8-9ef5-0687b6ed354a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:28.976296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7185d5c0-2408-46b8-9ef5-0687b6ed354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:29.083194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185d5c0-2408-46b8-9ef5-0687b6ed354a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:29.140214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:29.158364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aab7f3-b5b6-4683-9cf0-6bf7e40ba213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:29.159009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aab7f3-b5b6-4683-9cf0-6bf7e40ba213 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:29.159287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aab7f3-b5b6-4683-9cf0-6bf7e40ba213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:29.159555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aab7f3-b5b6-4683-9cf0-6bf7e40ba213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:29.161460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-52aab7f3-b5b6-4683-9cf0-6bf7e40ba213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:29.271768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aab7f3-b5b6-4683-9cf0-6bf7e40ba213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:29.273380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aab7f3-b5b6-4683-9cf0-6bf7e40ba213 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:29.291828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 738/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:31.341956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df0df-a59d-4814-af0f-f0099a8e2cd1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:31.343052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df0df-a59d-4814-af0f-f0099a8e2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:31.343052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df0df-a59d-4814-af0f-f0099a8e2cd1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:31.344679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:31.349862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc365c6-37db-400f-83b2-eb8275b20648 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:31.350275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc365c6-37db-400f-83b2-eb8275b20648 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:31.350411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc365c6-37db-400f-83b2-eb8275b20648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:31.422404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bbc365c6-37db-400f-83b2-eb8275b20648 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:31.423973 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bbc365c6-37db-400f-83b2-eb8275b20648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:31.464871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:31.528277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:31.566444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df0df-a59d-4814-af0f-f0099a8e2cd1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:31.568027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bf6df0df-a59d-4814-af0f-f0099a8e2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:31.676392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df0df-a59d-4814-af0f-f0099a8e2cd1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:31.713832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:31.766244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ba594-93a8-4ce7-853b-fb3ecb576053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:31.767032 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba594-93a8-4ce7-853b-fb3ecb576053 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:31.767456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba594-93a8-4ce7-853b-fb3ecb576053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:31.767867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba594-93a8-4ce7-853b-fb3ecb576053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:31.770403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-742ba594-93a8-4ce7-853b-fb3ecb576053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:31.887959 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ba594-93a8-4ce7-853b-fb3ecb576053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:31.889448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ba594-93a8-4ce7-853b-fb3ecb576053 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:31.908126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 725/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:33.992116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a75645-d371-4f47-a3ba-425e2d86ed4f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:33.992704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a75645-d371-4f47-a3ba-425e2d86ed4f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:33.992704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a75645-d371-4f47-a3ba-425e2d86ed4f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:33.994009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:33.999902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a5c62-bef9-4327-820f-158caf6d3def None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:34.000355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a5c62-bef9-4327-820f-158caf6d3def None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:34.000466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a5c62-bef9-4327-820f-158caf6d3def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:34.066540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-708a5c62-bef9-4327-820f-158caf6d3def None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:34.067792 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-708a5c62-bef9-4327-820f-158caf6d3def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:34.085710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:34.166604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:34.204455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a75645-d371-4f47-a3ba-425e2d86ed4f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:34.206218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c9a75645-d371-4f47-a3ba-425e2d86ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:34.317679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a75645-d371-4f47-a3ba-425e2d86ed4f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:34.384184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:34.392147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e460367-77be-47b0-82a1-f970e3cf352e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:34.392767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460367-77be-47b0-82a1-f970e3cf352e service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:34.393053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460367-77be-47b0-82a1-f970e3cf352e service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:34.393329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460367-77be-47b0-82a1-f970e3cf352e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:34.394990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7e460367-77be-47b0-82a1-f970e3cf352e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:34.506064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e460367-77be-47b0-82a1-f970e3cf352e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:34.507546 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e460367-77be-47b0-82a1-f970e3cf352e service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:34.526960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 741/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:36.597490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf086d95-80a6-49b4-ba09-d7c304ade192 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:36.598105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf086d95-80a6-49b4-ba09-d7c304ade192 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:36.598105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf086d95-80a6-49b4-ba09-d7c304ade192 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:36.599421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:36.604621 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866dddd-3cc6-4cb7-828f-962d6cbc39eb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:36.605036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866dddd-3cc6-4cb7-828f-962d6cbc39eb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:36.605181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866dddd-3cc6-4cb7-828f-962d6cbc39eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:36.671880 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9866dddd-3cc6-4cb7-828f-962d6cbc39eb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:36.673107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9866dddd-3cc6-4cb7-828f-962d6cbc39eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:36.721313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:36.769316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:36.805932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf086d95-80a6-49b4-ba09-d7c304ade192 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:36.807551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cf086d95-80a6-49b4-ba09-d7c304ade192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:36.920876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf086d95-80a6-49b4-ba09-d7c304ade192 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:36.971584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:36.999017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d862e2c-191a-4163-8cef-c9c1dd508aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:36.999640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d862e2c-191a-4163-8cef-c9c1dd508aad service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:36.999917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d862e2c-191a-4163-8cef-c9c1dd508aad service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:37.000187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d862e2c-191a-4163-8cef-c9c1dd508aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:37.001821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6d862e2c-191a-4163-8cef-c9c1dd508aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:37.109862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d862e2c-191a-4163-8cef-c9c1dd508aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:37.111329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d862e2c-191a-4163-8cef-c9c1dd508aad service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:37.129360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 728/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:46.767568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=22 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:47.127137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=66 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:56.844553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e833-4060-40e9-a9e7-ca3e4e4b01cb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:56.845375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e833-4060-40e9-a9e7-ca3e4e4b01cb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:56.845375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e833-4060-40e9-a9e7-ca3e4e4b01cb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:56.846786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 743/1471] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:43:56.851922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e42d-6f10-430b-92ee-b9499aa3b001 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:56.852399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e42d-6f10-430b-92ee-b9499aa3b001 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:56.852513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e42d-6f10-430b-92ee-b9499aa3b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:56.919056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ee21e42d-6f10-430b-92ee-b9499aa3b001 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:56.920778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ee21e42d-6f10-430b-92ee-b9499aa3b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:57.020237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 729/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:57.103483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15ff3-5b7a-4eb4-af7b-0f84bd438e85 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:57.103765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15ff3-5b7a-4eb4-af7b-0f84bd438e85 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:57.104038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15ff3-5b7a-4eb4-af7b-0f84bd438e85 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:57.105462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 744/1473] 10.222.0.18 () {54 vars in 966 bytes} [Wed Jul 27 07:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:57.110844 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10e752-25ff-4a6b-babc-ac46d6bac22c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:57.111160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10e752-25ff-4a6b-babc-ac46d6bac22c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:57.111432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10e752-25ff-4a6b-babc-ac46d6bac22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:57.188264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bf10e752-25ff-4a6b-babc-ac46d6bac22c None None] MFA Rules not processed for user `ad7a3c5f6b9645fb8cd2a65cee4f37c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:57.189474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bf10e752-25ff-4a6b-babc-ac46d6bac22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:57.209831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:57.269072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 730/1474] 10.222.0.18 () {58 vars in 1063 bytes} [Wed Jul 27 07:43:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:43:57.276680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15ff3-5b7a-4eb4-af7b-0f84bd438e85 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:57.278187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ded15ff3-5b7a-4eb4-af7b-0f84bd438e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:57.380551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15ff3-5b7a-4eb4-af7b-0f84bd438e85 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:43:57.454407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b928d6e-2e53-4913-a099-a5de17f17134 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7a3c5f6b9645fb8cd2a65cee4f37c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:43:57.455057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b928d6e-2e53-4913-a099-a5de17f17134 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:57.455338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b928d6e-2e53-4913-a099-a5de17f17134 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:57.455604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b928d6e-2e53-4913-a099-a5de17f17134 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:57.457221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6b928d6e-2e53-4913-a099-a5de17f17134 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:57.510106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:43:57.565186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b928d6e-2e53-4913-a099-a5de17f17134 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:43:57.566628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b928d6e-2e53-4913-a099-a5de17f17134 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:43:57.585305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 745/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:59.685425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5977-f635-4ffc-a9f1-a7f5b2dcc7c2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:59.686557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5977-f635-4ffc-a9f1-a7f5b2dcc7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:59.686557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5977-f635-4ffc-a9f1-a7f5b2dcc7c2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:59.687926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 731/1476] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:43:59.693439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd2a40-6b4a-455b-88af-957158c497a1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:43:59.693908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd2a40-6b4a-455b-88af-957158c497a1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:43:59.694011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd2a40-6b4a-455b-88af-957158c497a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:43:59.759609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5dbd2a40-6b4a-455b-88af-957158c497a1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:43:59.760829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5dbd2a40-6b4a-455b-88af-957158c497a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:43:59.858641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 746/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:43:59.883393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f5977-f635-4ffc-a9f1-a7f5b2dcc7c2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:43:59.885066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-df4f5977-f635-4ffc-a9f1-a7f5b2dcc7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:00.014363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f5977-f635-4ffc-a9f1-a7f5b2dcc7c2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:44:00.062592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:00.107348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d0f80-f598-4be3-b408-baa8dc74453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:44:00.107961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d0f80-f598-4be3-b408-baa8dc74453c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:00.108238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d0f80-f598-4be3-b408-baa8dc74453c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:00.108505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d0f80-f598-4be3-b408-baa8dc74453c admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:00.109200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d0f80-f598-4be3-b408-baa8dc74453c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:44:00.110937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-688d0f80-f598-4be3-b408-baa8dc74453c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:44:00.110937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jul 27 07:44:00.110937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: Jul 27 07:44:00.112073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d0f80-f598-4be3-b408-baa8dc74453c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:44:00.130695 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 732/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 27 07:43:59 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:44:02.171181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366fc4-9ec6-496d-84f6-98be812af404 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:02.171749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366fc4-9ec6-496d-84f6-98be812af404 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:02.171749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366fc4-9ec6-496d-84f6-98be812af404 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:02.173239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 747/1479] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:44:02.178407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e87ca-e219-4058-97cb-bfd25ee9080a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:02.178837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e87ca-e219-4058-97cb-bfd25ee9080a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:02.178965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e87ca-e219-4058-97cb-bfd25ee9080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:02.250589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6e3e87ca-e219-4058-97cb-bfd25ee9080a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:44:02.251854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6e3e87ca-e219-4058-97cb-bfd25ee9080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:02.348358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 733/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:44:02.391456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366fc4-9ec6-496d-84f6-98be812af404 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:44:02.394217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f7366fc4-9ec6-496d-84f6-98be812af404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:02.407351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:02.549323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366fc4-9ec6-496d-84f6-98be812af404 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:44:02.628213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:02.660956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a3410-1209-4199-a8ba-d81852f83988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:44:02.661570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3410-1209-4199-a8ba-d81852f83988 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:02.661846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3410-1209-4199-a8ba-d81852f83988 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:02.662116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3410-1209-4199-a8ba-d81852f83988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:02.663773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a17a3410-1209-4199-a8ba-d81852f83988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:02.754190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a3410-1209-4199-a8ba-d81852f83988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:44:02.755744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a3410-1209-4199-a8ba-d81852f83988 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:44:02.774696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 748/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:44:04.957249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9e77e-9bdb-4fcd-87a9-4dfc4d315f9d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:04.957782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9e77e-9bdb-4fcd-87a9-4dfc4d315f9d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:04.957782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9e77e-9bdb-4fcd-87a9-4dfc4d315f9d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:04.959176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 734/1482] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:44:04.964387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176521-0d21-4158-a02c-579904abd306 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:04.964909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176521-0d21-4158-a02c-579904abd306 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:04.965018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176521-0d21-4158-a02c-579904abd306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:05.031951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-72176521-0d21-4158-a02c-579904abd306 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:44:05.033082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-72176521-0d21-4158-a02c-579904abd306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:05.080476 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:05.131236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 749/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:44:05.167615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9e77e-9bdb-4fcd-87a9-4dfc4d315f9d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:44:05.169216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e2e9e77e-9bdb-4fcd-87a9-4dfc4d315f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:05.193942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:05.275286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9e77e-9bdb-4fcd-87a9-4dfc4d315f9d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:44:05.347814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808205c-ff43-40d1-990a-0209c940d999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:44:05.348435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808205c-ff43-40d1-990a-0209c940d999 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:05.348717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808205c-ff43-40d1-990a-0209c940d999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:05.348990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808205c-ff43-40d1-990a-0209c940d999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:05.350627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5808205c-ff43-40d1-990a-0209c940d999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:05.425309 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:05.461154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808205c-ff43-40d1-990a-0209c940d999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:44:05.462605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808205c-ff43-40d1-990a-0209c940d999 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:44:05.481485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 735/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:44:07.553601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92781934-aa29-4457-aedb-0ad72a644ff6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:07.554226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92781934-aa29-4457-aedb-0ad72a644ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:07.554226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92781934-aa29-4457-aedb-0ad72a644ff6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:07.555548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 750/1485] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:44:07.561448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87546b3a-f897-4a88-951d-1cdb5eac5014 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:07.561899 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87546b3a-f897-4a88-951d-1cdb5eac5014 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:07.562010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87546b3a-f897-4a88-951d-1cdb5eac5014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:07.629019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-87546b3a-f897-4a88-951d-1cdb5eac5014 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:44:07.630260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-87546b3a-f897-4a88-951d-1cdb5eac5014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:07.729008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 736/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:44:07.768544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92781934-aa29-4457-aedb-0ad72a644ff6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:44:07.770086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-92781934-aa29-4457-aedb-0ad72a644ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:07.874693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92781934-aa29-4457-aedb-0ad72a644ff6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:44:07.947432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:07.949508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf93e6-ee3b-42b6-a492-2988f18944f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:44:07.950283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf93e6-ee3b-42b6-a492-2988f18944f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:07.950749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf93e6-ee3b-42b6-a492-2988f18944f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:07.951220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf93e6-ee3b-42b6-a492-2988f18944f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:07.953623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3abf93e6-ee3b-42b6-a492-2988f18944f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:08.064129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf93e6-ee3b-42b6-a492-2988f18944f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:44:08.065573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf93e6-ee3b-42b6-a492-2988f18944f6 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:44:08.083499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 751/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:44:10.193461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b3a6e-70ca-4692-9c03-2052b6d59dee None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:10.194067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b3a6e-70ca-4692-9c03-2052b6d59dee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:10.194067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b3a6e-70ca-4692-9c03-2052b6d59dee None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:10.195447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 737/1488] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:44:10.200786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a016934-9a77-4fa1-a70e-5b1ba7e85e80 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:10.201219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a016934-9a77-4fa1-a70e-5b1ba7e85e80 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:10.201932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a016934-9a77-4fa1-a70e-5b1ba7e85e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:10.269923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9a016934-9a77-4fa1-a70e-5b1ba7e85e80 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:44:10.271176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9a016934-9a77-4fa1-a70e-5b1ba7e85e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:10.323134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:10.367483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 752/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:44:10.408110 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b3a6e-70ca-4692-9c03-2052b6d59dee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:44:10.409668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c58b3a6e-70ca-4692-9c03-2052b6d59dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:10.446965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:10.515601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b3a6e-70ca-4692-9c03-2052b6d59dee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:44:10.590823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255fd69-1f66-4a97-8c7d-06445e31c793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:44:10.591467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255fd69-1f66-4a97-8c7d-06445e31c793 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:10.591746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255fd69-1f66-4a97-8c7d-06445e31c793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:10.592603 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255fd69-1f66-4a97-8c7d-06445e31c793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:10.594236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3255fd69-1f66-4a97-8c7d-06445e31c793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:10.673897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:10.703783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255fd69-1f66-4a97-8c7d-06445e31c793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:44:10.705160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255fd69-1f66-4a97-8c7d-06445e31c793 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:44:10.723782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 738/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:44:12.971800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187d0fa-15b3-4625-ada8-087290e30ed4 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:12.972377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187d0fa-15b3-4625-ada8-087290e30ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:12.972377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187d0fa-15b3-4625-ada8-087290e30ed4 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:12.973735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 753/1491] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 27 07:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:44:12.979216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16bda2-eb22-49c7-8662-20a5be20bd2f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:12.979633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16bda2-eb22-49c7-8662-20a5be20bd2f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:12.979776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16bda2-eb22-49c7-8662-20a5be20bd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:13.049307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fb16bda2-eb22-49c7-8662-20a5be20bd2f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:44:13.050468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fb16bda2-eb22-49c7-8662-20a5be20bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:13.153074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 739/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 27 07:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:44:13.193886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187d0fa-15b3-4625-ada8-087290e30ed4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:44:13.195612 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c187d0fa-15b3-4625-ada8-087290e30ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:13.306767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187d0fa-15b3-4625-ada8-087290e30ed4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:44:13.378915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129428d-cb07-468d-95be-db809df3753d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:44:13.379523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129428d-cb07-468d-95be-db809df3753d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:44:13.379799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129428d-cb07-468d-95be-db809df3753d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:44:13.380067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129428d-cb07-468d-95be-db809df3753d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:44:13.381676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b129428d-cb07-468d-95be-db809df3753d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:44:13.391166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:13.494076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129428d-cb07-468d-95be-db809df3753d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:44:13.495542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129428d-cb07-468d-95be-db809df3753d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:44:13.513052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 754/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:44:23.151089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=82 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:23.510787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=50 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:41.377655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144b343-85de-4351-838b-6d8e6c2352f0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:41.378258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144b343-85de-4351-838b-6d8e6c2352f0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:41.378258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144b343-85de-4351-838b-6d8e6c2352f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:41.455426 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b144b343-85de-4351-838b-6d8e6c2352f0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:45:41.456673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b144b343-85de-4351-838b-6d8e6c2352f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:41.553072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 740/1494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:45:41.561755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7999a-09c1-41e1-98c2-4931b7989a96 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:41.562271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7999a-09c1-41e1-98c2-4931b7989a96 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:41.562271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7999a-09c1-41e1-98c2-4931b7989a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:41.640825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-eeb7999a-09c1-41e1-98c2-4931b7989a96 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:45:41.641956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-eeb7999a-09c1-41e1-98c2-4931b7989a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:41.737915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 755/1495] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:45:41.742578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144b343-85de-4351-838b-6d8e6c2352f0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:41.743849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b144b343-85de-4351-838b-6d8e6c2352f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:41.755995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144b343-85de-4351-838b-6d8e6c2352f0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:41.816811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:41.850692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:41.851344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:41.851623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:41.851892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:41.852585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:45:41.852887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:41.853891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:45:41.853891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jul 27 07:45:41.853891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: Jul 27 07:45:41.854773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:41.866433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 741/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:45:41.875579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7999a-09c1-41e1-98c2-4931b7989a96 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:41.884807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7999a-09c1-41e1-98c2-4931b7989a96 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:41.954295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:41.996442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:41.997066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:41.997344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:41.997616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:41.998288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:42.000052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:45:42.000052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jul 27 07:45:42.000052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: Jul 27 07:45:42.001339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:42.056792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 756/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:45:41 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:45:42.061093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:42.062633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:42.096873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604649ce-18ef-4204-b28a-9e1bf1067945 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:42.194125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:42.194741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:42.195054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:42.195325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:42.196274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:42.197280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:45:42.197280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jul 27 07:45:42.197280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: Jul 27 07:45:42.198494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:42.241416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 742/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:45:42 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:45:42.245668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:42.247890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:42.313588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8be00-facf-4176-8aea-909768c836cc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:42.398517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:42.411017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:42.411628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:42.411907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:42.412240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:42.412939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:42.413983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:45:42.413983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jul 27 07:45:42.413983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: Jul 27 07:45:42.414866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:42.427612 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 757/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:45:42.431596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:42.433123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:42.444660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0686d1-23b1-442a-9922-d98ecaafde74 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:42.470929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:42.543768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135074ff-2641-4870-9c9d-780686a5e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:42.544379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135074ff-2641-4870-9c9d-780686a5e23d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:42.544654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135074ff-2641-4870-9c9d-780686a5e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:42.544916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135074ff-2641-4870-9c9d-780686a5e23d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:42.545606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135074ff-2641-4870-9c9d-780686a5e23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:42.546644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-135074ff-2641-4870-9c9d-780686a5e23d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:45:42.546644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jul 27 07:45:42.546644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: Jul 27 07:45:42.547547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135074ff-2641-4870-9c9d-780686a5e23d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:42.559759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 743/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:45:42.564091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:42.565646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:42.599578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9d8fb-6fe3-43fd-97a6-9d2231cd9059 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:42.694347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab68f9-6862-4b4f-8e95-913f79e6e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:42.695059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab68f9-6862-4b4f-8e95-913f79e6e8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:42.695340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab68f9-6862-4b4f-8e95-913f79e6e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:42.695612 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab68f9-6862-4b4f-8e95-913f79e6e8e9 admin admin] PATH_INFO: `/v3/projects/9fba4c5acb31436d86fbadaa3520124a/users/29f891cc08f94e6abb0470062fe536bb/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:42.717623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab68f9-6862-4b4f-8e95-913f79e6e8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fba4c5acb31436d86fbadaa3520124a, user_id=29f891cc08f94e6abb0470062fe536bb, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:42.718673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-89ab68f9-6862-4b4f-8e95-913f79e6e8e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:45:42.718673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jul 27 07:45:42.718673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: Jul 27 07:45:42.720670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab68f9-6862-4b4f-8e95-913f79e6e8e9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:42.746864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 758/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:45:42 2022] PUT /identity/v3/projects/9fba4c5acb31436d86fbadaa3520124a/users/29f891cc08f94e6abb0470062fe536bb/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:45:42.760098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b6a5-5071-4b7e-9559-00566ed2309b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:42.760387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b6a5-5071-4b7e-9559-00566ed2309b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:42.760687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b6a5-5071-4b7e-9559-00566ed2309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:42.818823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7bc6b6a5-5071-4b7e-9559-00566ed2309b None None] MFA Rules not processed for user `29f891cc08f94e6abb0470062fe536bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:45:42.820090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7bc6b6a5-5071-4b7e-9559-00566ed2309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:42.904832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 744/1502] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:45:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:45:42.917862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28318-0fe2-4ec3-b7d5-18d5dece3491 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:42.918167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28318-0fe2-4ec3-b7d5-18d5dece3491 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:42.918451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28318-0fe2-4ec3-b7d5-18d5dece3491 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:42.919972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 759/1503] 10.222.0.18 () {54 vars in 964 bytes} [Wed Jul 27 07:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:45:42.924741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeed4f0-5170-4c0a-aa98-6fef83f2aaf2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:42.925030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeed4f0-5170-4c0a-aa98-6fef83f2aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:42.925301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeed4f0-5170-4c0a-aa98-6fef83f2aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:42.958082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:43.002905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4eeed4f0-5170-4c0a-aa98-6fef83f2aaf2 None None] MFA Rules not processed for user `ae1eae16b54c46e9a92f423094085b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:45:43.004159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4eeed4f0-5170-4c0a-aa98-6fef83f2aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:43.079160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 745/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Jul 27 07:45:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:45:43.087015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab28318-0fe2-4ec3-b7d5-18d5dece3491 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:43.088542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-aab28318-0fe2-4ec3-b7d5-18d5dece3491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:43.139569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:43.196775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab28318-0fe2-4ec3-b7d5-18d5dece3491 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:43.270032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:43.270645 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:43.270954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:43.271227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:43.272894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:43.373472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:43.374865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:43.378480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:43.393955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 760/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:45:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:45:43.439915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ba8e4-435a-4dec-84d5-d2b7476aec14 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:43.440362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ba8e4-435a-4dec-84d5-d2b7476aec14 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:43.440460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ba8e4-435a-4dec-84d5-d2b7476aec14 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:43.441736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 746/1506] 10.222.0.18 () {52 vars in 830 bytes} [Wed Jul 27 07:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:45:43.445535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:43.446759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:43.549241 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274938af-9787-407b-aacc-abbc8f7b82d2 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:43.642474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:43.643169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:43.643600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:43.643741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] PATH_INFO: `/v3/users/29f891cc08f94e6abb0470062fe536bb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:43.657963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f891cc08f94e6abb0470062fe536bb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:43.659057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:45:43.659057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jul 27 07:45:43.659057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: Jul 27 07:45:43.660291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:43.670705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:43.722494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f891cc08f94e6abb0470062fe536bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:43.731907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f891cc08f94e6abb0470062fe536bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:43.749449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f891cc08f94e6abb0470062fe536bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:43.749982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f891cc08f94e6abb0470062fe536bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:43.761940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f891cc08f94e6abb0470062fe536bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:43.767553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 761/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:45:43 2022] DELETE /identity/v3/users/29f891cc08f94e6abb0470062fe536bb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:45:43.771879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838adf-c46f-4fa8-a1dd-c4cd0f5294d4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:43.772157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838adf-c46f-4fa8-a1dd-c4cd0f5294d4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:43.772430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838adf-c46f-4fa8-a1dd-c4cd0f5294d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:43.829732 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c0838adf-c46f-4fa8-a1dd-c4cd0f5294d4 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:45:43.830994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c0838adf-c46f-4fa8-a1dd-c4cd0f5294d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:43.909918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:43.922253 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 747/1508] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:45:43.931927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:43.933185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:44.034715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a5517-22b3-49a3-9105-92fe38c5dd85 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:44.089366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:44.110419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878e32f-3bcc-4d41-9f2e-3babbe64db4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:44.111192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e32f-3bcc-4d41-9f2e-3babbe64db4d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:44.111476 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e32f-3bcc-4d41-9f2e-3babbe64db4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:44.111750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e32f-3bcc-4d41-9f2e-3babbe64db4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:44.113426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7878e32f-3bcc-4d41-9f2e-3babbe64db4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:44.225544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878e32f-3bcc-4d41-9f2e-3babbe64db4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:44.226999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878e32f-3bcc-4d41-9f2e-3babbe64db4d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:44.245380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 762/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:45:44.566922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0838adf-c46f-4fa8-a1dd-c4cd0f5294d4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:45:44.568272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c0838adf-c46f-4fa8-a1dd-c4cd0f5294d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:45:44.580805 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0838adf-c46f-4fa8-a1dd-c4cd0f5294d4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:45:44.680012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:45:44.680660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:45:44.680940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:45:44.681213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] PATH_INFO: `/v3/projects/9fba4c5acb31436d86fbadaa3520124a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:45:44.691833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fba4c5acb31436d86fbadaa3520124a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:45:44.693887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:45:44.693887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jul 27 07:45:44.693887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: Jul 27 07:45:44.695130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:45:44.753560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fba4c5acb31436d86fbadaa3520124a', 'request_id': 'req-769433d3-0de7-4e6a-9420-50f2cc6c6bce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:44.763470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fba4c5acb31436d86fbadaa3520124a', 'request_id': 'req-769433d3-0de7-4e6a-9420-50f2cc6c6bce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:44.769533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fba4c5acb31436d86fbadaa3520124a', 'request_id': 'req-769433d3-0de7-4e6a-9420-50f2cc6c6bce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:44.799044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] The token cache is being invalidate because project 9fba4c5acb31436d86fbadaa3520124a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:45:44.799333 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:44.799767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-769433d3-0de7-4e6a-9420-50f2cc6c6bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:45:44.801200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 748/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:45:44 2022] DELETE /identity/v3/projects/9fba4c5acb31436d86fbadaa3520124a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:45:54.243111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=62 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:45:54.796987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:47:24.937015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5823-fcc3-404e-881e-b77435a0769e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:24.937630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5823-fcc3-404e-881e-b77435a0769e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:24.937630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5823-fcc3-404e-881e-b77435a0769e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:24.938982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:47:24.943955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba3a1e-43f0-4fc1-9d06-74ce30adafa1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:24.944394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba3a1e-43f0-4fc1-9d06-74ce30adafa1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:24.944498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba3a1e-43f0-4fc1-9d06-74ce30adafa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:25.026681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9dba3a1e-43f0-4fc1-9d06-74ce30adafa1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:25.027933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9dba3a1e-43f0-4fc1-9d06-74ce30adafa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:25.131560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:25.293219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5823-fcc3-404e-881e-b77435a0769e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:47:25.295541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d83f5823-fcc3-404e-881e-b77435a0769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:25.418332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5823-fcc3-404e-881e-b77435a0769e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:47:25.424452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cea76-b4d0-422e-a3d8-87696f14b65f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:47:25.425079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cea76-b4d0-422e-a3d8-87696f14b65f service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:25.425355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cea76-b4d0-422e-a3d8-87696f14b65f service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:25.425623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cea76-b4d0-422e-a3d8-87696f14b65f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:25.435474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cea76-b4d0-422e-a3d8-87696f14b65f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:47:25.437073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cea76-b4d0-422e-a3d8-87696f14b65f service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:47:25.446652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 764/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:47:26.287749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853d13-5924-4794-97c7-9e6e343faab3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:26.288328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853d13-5924-4794-97c7-9e6e343faab3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:26.288328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853d13-5924-4794-97c7-9e6e343faab3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:26.289629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:47:26.294630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ff5ac-fbd3-4fd1-a449-85f231e2421a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:26.295078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ff5ac-fbd3-4fd1-a449-85f231e2421a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:26.295213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ff5ac-fbd3-4fd1-a449-85f231e2421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:26.314779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d40ff5ac-fbd3-4fd1-a449-85f231e2421a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:26.316006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d40ff5ac-fbd3-4fd1-a449-85f231e2421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:26.324466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:26.478115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853d13-5924-4794-97c7-9e6e343faab3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:47:26.492713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853d13-5924-4794-97c7-9e6e343faab3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:47:26.498676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8a392-5c1c-47d9-b3fa-4bdef9a65d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:47:26.499317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8a392-5c1c-47d9-b3fa-4bdef9a65d7b service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:26.499593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8a392-5c1c-47d9-b3fa-4bdef9a65d7b service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:26.499863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8a392-5c1c-47d9-b3fa-4bdef9a65d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:26.508126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8a392-5c1c-47d9-b3fa-4bdef9a65d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:47:26.510295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8a392-5c1c-47d9-b3fa-4bdef9a65d7b service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:47:26.519675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 751/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:47:27.052947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f8ba6-f354-49ba-9d33-c349a99062a3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:27.053231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f8ba6-f354-49ba-9d33-c349a99062a3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:27.053505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f8ba6-f354-49ba-9d33-c349a99062a3 None None] PATH_INFO: `/v3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:27.054858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 766/1517] 10.222.0.33 () {54 vars in 925 bytes} [Wed Jul 27 07:47:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:47:27.061937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe571f9-716e-42d3-91e6-aa08959ccd02 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:27.062227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe571f9-716e-42d3-91e6-aa08959ccd02 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:27.062507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe571f9-716e-42d3-91e6-aa08959ccd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:27.121637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ebe571f9-716e-42d3-91e6-aa08959ccd02 None None] MFA Rules not processed for user `beaec3b392e3468981992629101cf883`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:27.122857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ebe571f9-716e-42d3-91e6-aa08959ccd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:27.140189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:47:27.195485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 752/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Jul 27 07:47:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:36.268108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b66b63-8c25-4bd0-af21-a408e93aea6b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:36.268648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b66b63-8c25-4bd0-af21-a408e93aea6b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:36.268648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b66b63-8c25-4bd0-af21-a408e93aea6b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:36.269906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 767/1519] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jul 27 07:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:47:36.275474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1603ce-724e-4ff0-96a2-420cec59f262 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:36.275912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1603ce-724e-4ff0-96a2-420cec59f262 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:36.276020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1603ce-724e-4ff0-96a2-420cec59f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:36.295668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cd1603ce-724e-4ff0-96a2-420cec59f262 None None] MFA Rules not processed for user `beaec3b392e3468981992629101cf883`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:36.296885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cd1603ce-724e-4ff0-96a2-420cec59f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:36.305480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 753/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jul 27 07:47:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:36.310006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=56 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:47:36.313656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b66b63-8c25-4bd0-af21-a408e93aea6b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:47:36.327783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b66b63-8c25-4bd0-af21-a408e93aea6b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:47:36.332685 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf62ac7-6c1d-47d7-937a-f5933c6afba8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:47:36.333290 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf62ac7-6c1d-47d7-937a-f5933c6afba8 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:36.333573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf62ac7-6c1d-47d7-937a-f5933c6afba8 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:36.333848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf62ac7-6c1d-47d7-937a-f5933c6afba8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:36.342734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf62ac7-6c1d-47d7-937a-f5933c6afba8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:47:36.344374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf62ac7-6c1d-47d7-937a-f5933c6afba8 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:47:36.354174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 768/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:47:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:47:37.793269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11255b-b549-4cb5-bd70-f6209a2432c8 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:37.793851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11255b-b549-4cb5-bd70-f6209a2432c8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:37.793851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11255b-b549-4cb5-bd70-f6209a2432c8 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:37.795145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:47:37.800088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82050-479a-4fbf-abb1-a561108eacf0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:37.800532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82050-479a-4fbf-abb1-a561108eacf0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:37.800643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82050-479a-4fbf-abb1-a561108eacf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:37.820577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-14e82050-479a-4fbf-abb1-a561108eacf0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:37.821843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-14e82050-479a-4fbf-abb1-a561108eacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:37.829900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:37.984256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11255b-b549-4cb5-bd70-f6209a2432c8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:47:37.999524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11255b-b549-4cb5-bd70-f6209a2432c8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:47:38.004971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00263d5-1b2d-4d0d-802d-de3e78a836e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:47:38.005586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00263d5-1b2d-4d0d-802d-de3e78a836e9 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:38.005866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00263d5-1b2d-4d0d-802d-de3e78a836e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:38.006137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00263d5-1b2d-4d0d-802d-de3e78a836e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:38.014298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00263d5-1b2d-4d0d-802d-de3e78a836e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:47:38.015908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00263d5-1b2d-4d0d-802d-de3e78a836e9 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:47:38.025211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 755/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:47:38.854068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ce46b-18c7-4093-b936-4b486ea61d34 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:38.854710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ce46b-18c7-4093-b936-4b486ea61d34 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:38.854710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ce46b-18c7-4093-b936-4b486ea61d34 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:38.855994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 07:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:47:38.860719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdba436-4691-478c-9a3c-2a8debd27992 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:38.861110 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdba436-4691-478c-9a3c-2a8debd27992 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:38.861271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdba436-4691-478c-9a3c-2a8debd27992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:38.883167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5bdba436-4691-478c-9a3c-2a8debd27992 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:38.884437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5bdba436-4691-478c-9a3c-2a8debd27992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:38.892770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 07:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:39.044297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ce46b-18c7-4093-b936-4b486ea61d34 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:47:39.058905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ce46b-18c7-4093-b936-4b486ea61d34 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:47:39.064487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f1cc2-8e8f-4154-a1b4-562d86862684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:47:39.065091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f1cc2-8e8f-4154-a1b4-562d86862684 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:39.065373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f1cc2-8e8f-4154-a1b4-562d86862684 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:39.065651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f1cc2-8e8f-4154-a1b4-562d86862684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:39.074026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f1cc2-8e8f-4154-a1b4-562d86862684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:47:39.075654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f1cc2-8e8f-4154-a1b4-562d86862684 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:47:39.085536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 771/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:47:42.896238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6aa6cc-1721-4ca9-8731-c68752e99b4e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:42.896807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6aa6cc-1721-4ca9-8731-c68752e99b4e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:42.896807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6aa6cc-1721-4ca9-8731-c68752e99b4e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:42.898144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:47:42.903577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcaab6-c3d7-4b33-8cb4-b6dc8a7de965 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:42.904012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcaab6-c3d7-4b33-8cb4-b6dc8a7de965 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:42.904121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcaab6-c3d7-4b33-8cb4-b6dc8a7de965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:42.923166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fcbcaab6-c3d7-4b33-8cb4-b6dc8a7de965 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:42.924367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fcbcaab6-c3d7-4b33-8cb4-b6dc8a7de965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:42.932631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:43.005880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6aa6cc-1721-4ca9-8731-c68752e99b4e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:47:43.007610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1b6aa6cc-1721-4ca9-8731-c68752e99b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:43.086313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6aa6cc-1721-4ca9-8731-c68752e99b4e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:47:43.090115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35d5e3-c68e-4c14-a225-e26b4c548b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:47:43.090728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35d5e3-c68e-4c14-a225-e26b4c548b43 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:43.091048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35d5e3-c68e-4c14-a225-e26b4c548b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:43.091326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35d5e3-c68e-4c14-a225-e26b4c548b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:43.100638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35d5e3-c68e-4c14-a225-e26b4c548b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:47:43.102060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35d5e3-c68e-4c14-a225-e26b4c548b43 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:47:43.112504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 758/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:47:45.110948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fabff1-90b1-4d68-9070-c199a6a40b1f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:45.111488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fabff1-90b1-4d68-9070-c199a6a40b1f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:45.111488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fabff1-90b1-4d68-9070-c199a6a40b1f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:45.112875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:47:45.118205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db775f2-c57c-4583-9126-f1774e9836ec None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:45.119228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db775f2-c57c-4583-9126-f1774e9836ec None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:45.119320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db775f2-c57c-4583-9126-f1774e9836ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:45.139047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9db775f2-c57c-4583-9126-f1774e9836ec None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:45.140260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9db775f2-c57c-4583-9126-f1774e9836ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:45.148134 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:45.193750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fabff1-90b1-4d68-9070-c199a6a40b1f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:47:45.195979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-08fabff1-90b1-4d68-9070-c199a6a40b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:45.210483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fabff1-90b1-4d68-9070-c199a6a40b1f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:47:45.214075 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac38c-5359-432e-b08c-24cfe9a69494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:47:45.214680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac38c-5359-432e-b08c-24cfe9a69494 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:45.214989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac38c-5359-432e-b08c-24cfe9a69494 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:45.215265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac38c-5359-432e-b08c-24cfe9a69494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:45.224420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ac38c-5359-432e-b08c-24cfe9a69494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:47:45.225834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ac38c-5359-432e-b08c-24cfe9a69494 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:47:45.235335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 774/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:47:48.835530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf9975-65ed-4dc4-8a1b-503997b35c4a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:48.836089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf9975-65ed-4dc4-8a1b-503997b35c4a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:48.836089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf9975-65ed-4dc4-8a1b-503997b35c4a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:48.837511 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:47:48.842860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103aad3-109a-489a-8526-e50421760abf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:48.843300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103aad3-109a-489a-8526-e50421760abf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:48.843444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103aad3-109a-489a-8526-e50421760abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:48.862767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9103aad3-109a-489a-8526-e50421760abf None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:48.863999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9103aad3-109a-489a-8526-e50421760abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:48.872535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:49.174053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf9975-65ed-4dc4-8a1b-503997b35c4a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:47:49.175757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-efcf9975-65ed-4dc4-8a1b-503997b35c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:49.239546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:47:49.253292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf9975-65ed-4dc4-8a1b-503997b35c4a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:47:49.256892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e24e3-0dd3-4d20-b6ae-57b3beafd059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:47:49.257504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e24e3-0dd3-4d20-b6ae-57b3beafd059 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:49.257811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e24e3-0dd3-4d20-b6ae-57b3beafd059 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:49.258077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e24e3-0dd3-4d20-b6ae-57b3beafd059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:49.267695 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e24e3-0dd3-4d20-b6ae-57b3beafd059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:47:49.269116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e24e3-0dd3-4d20-b6ae-57b3beafd059 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:47:49.279145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 761/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:47:51.326899 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f06a75-ee09-4b30-9329-c4612753fea7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:51.327466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f06a75-ee09-4b30-9329-c4612753fea7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:51.327564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f06a75-ee09-4b30-9329-c4612753fea7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:51.328903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 07:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:47:51.334034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a088b2-7ca5-40ed-beb7-3da41f476941 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:51.334497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a088b2-7ca5-40ed-beb7-3da41f476941 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:51.334605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a088b2-7ca5-40ed-beb7-3da41f476941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:51.354866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a1a088b2-7ca5-40ed-beb7-3da41f476941 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:47:51.356099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1a088b2-7ca5-40ed-beb7-3da41f476941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:51.363952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 07:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:47:51.664248 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f06a75-ee09-4b30-9329-c4612753fea7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:47:51.665987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-50f06a75-ee09-4b30-9329-c4612753fea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:47:51.678605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f06a75-ee09-4b30-9329-c4612753fea7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:47:51.682532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2712fc-abe5-41ac-929a-3ee83815a953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:47:51.683178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2712fc-abe5-41ac-929a-3ee83815a953 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:47:51.683450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2712fc-abe5-41ac-929a-3ee83815a953 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:47:51.683717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2712fc-abe5-41ac-929a-3ee83815a953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:47:51.692372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2712fc-abe5-41ac-929a-3ee83815a953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:47:51.693780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2712fc-abe5-41ac-929a-3ee83815a953 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:47:51.703594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 777/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:48:01.350156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=11 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:48:01.699657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=33 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:20.948627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f6c1f-8453-4d6a-bb64-42bfab3413eb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:20.949282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f6c1f-8453-4d6a-bb64-42bfab3413eb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:20.949282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f6c1f-8453-4d6a-bb64-42bfab3413eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:20.974524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6d6f6c1f-8453-4d6a-bb64-42bfab3413eb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:20.976200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6d6f6c1f-8453-4d6a-bb64-42bfab3413eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:20.990205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 763/1540] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:20.999421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fb643-f99a-453b-abfe-15a80ddfa7ae None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.000030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fb643-f99a-453b-abfe-15a80ddfa7ae None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.000030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fb643-f99a-453b-abfe-15a80ddfa7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.032123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-606fb643-f99a-453b-abfe-15a80ddfa7ae None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.033355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-606fb643-f99a-453b-abfe-15a80ddfa7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.047673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 778/1541] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.052508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f6c1f-8453-4d6a-bb64-42bfab3413eb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.068943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f6c1f-8453-4d6a-bb64-42bfab3413eb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.080416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267d9b2-82b2-4731-a21f-2a963bbd447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.081384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267d9b2-82b2-4731-a21f-2a963bbd447c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.081903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267d9b2-82b2-4731-a21f-2a963bbd447c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.082410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267d9b2-82b2-4731-a21f-2a963bbd447c admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.083467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267d9b2-82b2-4731-a21f-2a963bbd447c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:21.084573 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267d9b2-82b2-4731-a21f-2a963bbd447c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.086422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267d9b2-82b2-4731-a21f-2a963bbd447c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.101655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a26cd-225a-424a-8643-c17665fac9f9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.101985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a26cd-225a-424a-8643-c17665fac9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.102464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a26cd-225a-424a-8643-c17665fac9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.106053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 764/1542] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:49:21.119562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267d9b2-82b2-4731-a21f-2a963bbd447c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.136531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267d9b2-82b2-4731-a21f-2a963bbd447c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.140000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4e3a26cd-225a-424a-8643-c17665fac9f9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.141420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4e3a26cd-225a-424a-8643-c17665fac9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.145513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391f28a-11f7-466a-a80e-fcd78f0bcbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.146470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391f28a-11f7-466a-a80e-fcd78f0bcbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.147003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391f28a-11f7-466a-a80e-fcd78f0bcbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.147525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391f28a-11f7-466a-a80e-fcd78f0bcbcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.148436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391f28a-11f7-466a-a80e-fcd78f0bcbcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.149677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-5391f28a-11f7-466a-a80e-fcd78f0bcbcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:49:21.149677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jul 27 07:49:21.149677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: Jul 27 07:49:21.151530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391f28a-11f7-466a-a80e-fcd78f0bcbcd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.158909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 779/1543] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.172357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf4fa-79e6-4f1e-b205-c1930412816d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.172745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf4fa-79e6-4f1e-b205-c1930412816d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.172925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf4fa-79e6-4f1e-b205-c1930412816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.224211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 765/1544] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:49:21.230029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391f28a-11f7-466a-a80e-fcd78f0bcbcd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.230184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7b6bf4fa-79e6-4f1e-b205-c1930412816d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.231242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7b6bf4fa-79e6-4f1e-b205-c1930412816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.332155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391f28a-11f7-466a-a80e-fcd78f0bcbcd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.344702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e3463-66ce-4b4b-9bdc-c4cefaf5c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.345716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e3463-66ce-4b4b-9bdc-c4cefaf5c440 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.346263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e3463-66ce-4b4b-9bdc-c4cefaf5c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.346759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e3463-66ce-4b4b-9bdc-c4cefaf5c440 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.347713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e3463-66ce-4b4b-9bdc-c4cefaf5c440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.350207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e3463-66ce-4b4b-9bdc-c4cefaf5c440 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.370334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 780/1545] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.370334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919f5a-66b6-4697-8be0-65d3d89a0471 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.370334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919f5a-66b6-4697-8be0-65d3d89a0471 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.370334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca919f5a-66b6-4697-8be0-65d3d89a0471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.382098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 766/1546] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:49:21.384077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c154-0f84-4b50-b00b-b496a6aba57c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.384686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c154-0f84-4b50-b00b-b496a6aba57c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.385206 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c154-0f84-4b50-b00b-b496a6aba57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.391969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ca919f5a-66b6-4697-8be0-65d3d89a0471 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.393428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ca919f5a-66b6-4697-8be0-65d3d89a0471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.402922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 781/1547] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.408411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-33d4c154-0f84-4b50-b00b-b496a6aba57c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.409473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d31cc-7d2c-46ad-9c6c-769531cec521 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.409601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-33d4c154-0f84-4b50-b00b-b496a6aba57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.410061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d31cc-7d2c-46ad-9c6c-769531cec521 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.410517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d31cc-7d2c-46ad-9c6c-769531cec521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.422512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 767/1548] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.432059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e31e1-6d93-48a8-8879-5e1b5b4ade9f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.432059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e31e1-6d93-48a8-8879-5e1b5b4ade9f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.432059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e31e1-6d93-48a8-8879-5e1b5b4ade9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.446331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-165d31cc-7d2c-46ad-9c6c-769531cec521 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.447588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-165d31cc-7d2c-46ad-9c6c-769531cec521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.455262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eb6e31e1-6d93-48a8-8879-5e1b5b4ade9f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.456019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 782/1549] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.456665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eb6e31e1-6d93-48a8-8879-5e1b5b4ade9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.462649 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d31cc-7d2c-46ad-9c6c-769531cec521 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.470786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 768/1550] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.471774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e31e1-6d93-48a8-8879-5e1b5b4ade9f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.473174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d31cc-7d2c-46ad-9c6c-769531cec521 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.478300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa62723-fd87-4694-8dd5-36945cef366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.478951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa62723-fd87-4694-8dd5-36945cef366d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.479234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa62723-fd87-4694-8dd5-36945cef366d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.479785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa62723-fd87-4694-8dd5-36945cef366d admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.480558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa62723-fd87-4694-8dd5-36945cef366d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:21.480805 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa62723-fd87-4694-8dd5-36945cef366d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.481829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-0aa62723-fd87-4694-8dd5-36945cef366d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:49:21.481829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jul 27 07:49:21.481829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: Jul 27 07:49:21.482300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e31e1-6d93-48a8-8879-5e1b5b4ade9f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.482723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa62723-fd87-4694-8dd5-36945cef366d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.486979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57218633-74ab-402d-b29d-813668963d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.487597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57218633-74ab-402d-b29d-813668963d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.487885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57218633-74ab-402d-b29d-813668963d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.488164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57218633-74ab-402d-b29d-813668963d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.488866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57218633-74ab-402d-b29d-813668963d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.491032 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57218633-74ab-402d-b29d-813668963d28 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.495456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 783/1551] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:21.497012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741d3d5-08bc-4acf-b237-ea2701cd87f8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.497296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741d3d5-08bc-4acf-b237-ea2701cd87f8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.497568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741d3d5-08bc-4acf-b237-ea2701cd87f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.504356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 769/1552] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:21.504356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d51a0-1143-47f1-8bbe-d2c67772ec7d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.504356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d51a0-1143-47f1-8bbe-d2c67772ec7d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.504356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d51a0-1143-47f1-8bbe-d2c67772ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.521523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f741d3d5-08bc-4acf-b237-ea2701cd87f8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.522705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e38d51a0-1143-47f1-8bbe-d2c67772ec7d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.522848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f741d3d5-08bc-4acf-b237-ea2701cd87f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.523925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e38d51a0-1143-47f1-8bbe-d2c67772ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.530590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 784/1553] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.531831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6349f4-a30f-41c3-983c-8b6ece2e198e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.532115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6349f4-a30f-41c3-983c-8b6ece2e198e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.532387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6349f4-a30f-41c3-983c-8b6ece2e198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.536477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 770/1554] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.537842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba35ed-959f-47a0-98c0-9e2efc121752 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.538133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba35ed-959f-47a0-98c0-9e2efc121752 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.538412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba35ed-959f-47a0-98c0-9e2efc121752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.555530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ea6349f4-a30f-41c3-983c-8b6ece2e198e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.556723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ea6349f4-a30f-41c3-983c-8b6ece2e198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.558515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0eba35ed-959f-47a0-98c0-9e2efc121752 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.559736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0eba35ed-959f-47a0-98c0-9e2efc121752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.565275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 785/1555] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.567323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b41b7-cbee-4ccc-8d53-73c9247d731e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.567606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b41b7-cbee-4ccc-8d53-73c9247d731e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.572122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b41b7-cbee-4ccc-8d53-73c9247d731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.572298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 771/1556] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.572298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcfbe8-d863-40fa-8bef-2cd61d758f32 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.572298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcfbe8-d863-40fa-8bef-2cd61d758f32 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.572298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcfbe8-d863-40fa-8bef-2cd61d758f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.588350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9d0b41b7-cbee-4ccc-8d53-73c9247d731e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.589548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9d0b41b7-cbee-4ccc-8d53-73c9247d731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.590339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b0bcfbe8-d863-40fa-8bef-2cd61d758f32 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.591556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b0bcfbe8-d863-40fa-8bef-2cd61d758f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.597348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 786/1557] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.598090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b41b7-cbee-4ccc-8d53-73c9247d731e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.600128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 772/1558] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.600858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcfbe8-d863-40fa-8bef-2cd61d758f32 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.611740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b41b7-cbee-4ccc-8d53-73c9247d731e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.611939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcfbe8-d863-40fa-8bef-2cd61d758f32 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.617058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381046d-1d24-40a4-8be9-02168af1b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.617415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568d40d-69ef-4eab-9420-f5264042c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.617675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381046d-1d24-40a4-8be9-02168af1b51c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.617956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381046d-1d24-40a4-8be9-02168af1b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.618062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568d40d-69ef-4eab-9420-f5264042c521 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.618232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381046d-1d24-40a4-8be9-02168af1b51c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.618338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568d40d-69ef-4eab-9420-f5264042c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.618542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568d40d-69ef-4eab-9420-f5264042c521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.618960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381046d-1d24-40a4-8be9-02168af1b51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.619244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568d40d-69ef-4eab-9420-f5264042c521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.620566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381046d-1d24-40a4-8be9-02168af1b51c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.621138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568d40d-69ef-4eab-9420-f5264042c521 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.630698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 773/1559] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:21.632126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381046d-1d24-40a4-8be9-02168af1b51c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.642511 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381046d-1d24-40a4-8be9-02168af1b51c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.647711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2716f6-7d91-4133-b620-a9a713d4d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.648315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2716f6-7d91-4133-b620-a9a713d4d49e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.648596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2716f6-7d91-4133-b620-a9a713d4d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.648871 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2716f6-7d91-4133-b620-a9a713d4d49e admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.649566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2716f6-7d91-4133-b620-a9a713d4d49e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:21.652930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 787/1560] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:21.653067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2716f6-7d91-4133-b620-a9a713d4d49e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.653176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568d40d-69ef-4eab-9420-f5264042c521 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.653276 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2716f6-7d91-4133-b620-a9a713d4d49e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.665093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 774/1561] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:21.665876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2716f6-7d91-4133-b620-a9a713d4d49e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.675531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2716f6-7d91-4133-b620-a9a713d4d49e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.705038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:21.721937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568d40d-69ef-4eab-9420-f5264042c521 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.727471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c2852-6297-4741-ac35-6fa2c32b48dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.728125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c2852-6297-4741-ac35-6fa2c32b48dc admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.728410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c2852-6297-4741-ac35-6fa2c32b48dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.728684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c2852-6297-4741-ac35-6fa2c32b48dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.729383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c2852-6297-4741-ac35-6fa2c32b48dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:21.729708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c2852-6297-4741-ac35-6fa2c32b48dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.731388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c2852-6297-4741-ac35-6fa2c32b48dc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.735185 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87220ae1-0f09-46eb-b276-ee5e0ad19b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.735808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87220ae1-0f09-46eb-b276-ee5e0ad19b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.736205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87220ae1-0f09-46eb-b276-ee5e0ad19b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.736390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87220ae1-0f09-46eb-b276-ee5e0ad19b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.737097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87220ae1-0f09-46eb-b276-ee5e0ad19b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:21.737558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87220ae1-0f09-46eb-b276-ee5e0ad19b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.739189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87220ae1-0f09-46eb-b276-ee5e0ad19b3b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.743677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 788/1562] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:21.744911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae3171-407b-407c-9afb-b0af62127992 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.745203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae3171-407b-407c-9afb-b0af62127992 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.746282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae3171-407b-407c-9afb-b0af62127992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.756619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 775/1563] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:21.756619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87220ae1-0f09-46eb-b276-ee5e0ad19b3b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.766239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87220ae1-0f09-46eb-b276-ee5e0ad19b3b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.770862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc8fc3-7427-4540-8e40-9cd975292e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.771178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-28ae3171-407b-407c-9afb-b0af62127992 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.771553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc8fc3-7427-4540-8e40-9cd975292e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.771828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc8fc3-7427-4540-8e40-9cd975292e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.772094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc8fc3-7427-4540-8e40-9cd975292e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.772393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-28ae3171-407b-407c-9afb-b0af62127992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.772807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc8fc3-7427-4540-8e40-9cd975292e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:21.773119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc8fc3-7427-4540-8e40-9cd975292e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.774686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc8fc3-7427-4540-8e40-9cd975292e96 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.780832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 789/1564] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.784688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9b54d-b13a-468e-8001-46a3916b9d7d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.784688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9b54d-b13a-468e-8001-46a3916b9d7d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.784688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9b54d-b13a-468e-8001-46a3916b9d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.788212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 776/1565] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:21.789093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc8fc3-7427-4540-8e40-9cd975292e96 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.797981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:21.804852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d6a9b54d-b13a-468e-8001-46a3916b9d7d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:21.806368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc8fc3-7427-4540-8e40-9cd975292e96 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.806511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d6a9b54d-b13a-468e-8001-46a3916b9d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:21.811545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7bfde-c356-4230-be2c-b1cd3e527468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.812218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7bfde-c356-4230-be2c-b1cd3e527468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.812522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7bfde-c356-4230-be2c-b1cd3e527468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.812790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7bfde-c356-4230-be2c-b1cd3e527468 admin admin] PATH_INFO: `/v3/projects/88e9fffbb5c6457ca3bc45c6226230a3/users/7e3a5b392d9d44859110f048bea7331b/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.814972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 790/1566] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:21.815988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9b54d-b13a-468e-8001-46a3916b9d7d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.825863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9b54d-b13a-468e-8001-46a3916b9d7d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.828605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7bfde-c356-4230-be2c-b1cd3e527468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e9fffbb5c6457ca3bc45c6226230a3, user_id=7e3a5b392d9d44859110f048bea7331b, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.829651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-bdf7bfde-c356-4230-be2c-b1cd3e527468 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:49:21.829651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jul 27 07:49:21.829651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: Jul 27 07:49:21.830566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36f5e-f325-4abb-b6d9-857c9c47f68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.831224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36f5e-f325-4abb-b6d9-857c9c47f68e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.831503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36f5e-f325-4abb-b6d9-857c9c47f68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.831651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7bfde-c356-4230-be2c-b1cd3e527468 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.831790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36f5e-f325-4abb-b6d9-857c9c47f68e admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.832451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b36f5e-f325-4abb-b6d9-857c9c47f68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.833466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-42b36f5e-f325-4abb-b6d9-857c9c47f68e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:49:21.833466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jul 27 07:49:21.833466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: Jul 27 07:49:21.835092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b36f5e-f325-4abb-b6d9-857c9c47f68e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.846304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 777/1567] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:21 2022] PUT /identity/v3/projects/88e9fffbb5c6457ca3bc45c6226230a3/users/7e3a5b392d9d44859110f048bea7331b/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:21.851188 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7bfde-c356-4230-be2c-b1cd3e527468 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.864472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 791/1568] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:21.864472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36f5e-f325-4abb-b6d9-857c9c47f68e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.873005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36f5e-f325-4abb-b6d9-857c9c47f68e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.914112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7bfde-c356-4230-be2c-b1cd3e527468 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:21.918751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28558181-3ccf-4ee3-aaac-3f9946886587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.919398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28558181-3ccf-4ee3-aaac-3f9946886587 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.919671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28558181-3ccf-4ee3-aaac-3f9946886587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.919946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28558181-3ccf-4ee3-aaac-3f9946886587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.920611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28558181-3ccf-4ee3-aaac-3f9946886587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.922513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28558181-3ccf-4ee3-aaac-3f9946886587 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.931403 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe4846-dcf5-4663-83f9-2ae4bfc35607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:21.932028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe4846-dcf5-4663-83f9-2ae4bfc35607 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:21.932314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe4846-dcf5-4663-83f9-2ae4bfc35607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:21.932592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe4846-dcf5-4663-83f9-2ae4bfc35607 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:21.933262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe4846-dcf5-4663-83f9-2ae4bfc35607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:21.935216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe4846-dcf5-4663-83f9-2ae4bfc35607 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:21.950721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 778/1569] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:21.954858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28558181-3ccf-4ee3-aaac-3f9946886587 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:21.965507 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 792/1570] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:21.966280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe4846-dcf5-4663-83f9-2ae4bfc35607 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.020692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28558181-3ccf-4ee3-aaac-3f9946886587 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.025243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aab522-e89d-4fe9-9877-acf7947c1ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.025860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aab522-e89d-4fe9-9877-acf7947c1ada admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.026134 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aab522-e89d-4fe9-9877-acf7947c1ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.026403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aab522-e89d-4fe9-9877-acf7947c1ada admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.027089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aab522-e89d-4fe9-9877-acf7947c1ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.028999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aab522-e89d-4fe9-9877-acf7947c1ada admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.029141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe4846-dcf5-4663-83f9-2ae4bfc35607 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.033937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647e0e-47fd-47d5-9314-f57c55fc22f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.034681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647e0e-47fd-47d5-9314-f57c55fc22f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.035058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647e0e-47fd-47d5-9314-f57c55fc22f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.035451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647e0e-47fd-47d5-9314-f57c55fc22f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.036178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09647e0e-47fd-47d5-9314-f57c55fc22f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:22.036483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09647e0e-47fd-47d5-9314-f57c55fc22f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.038583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09647e0e-47fd-47d5-9314-f57c55fc22f4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.050936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:22.051822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 793/1571] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:22.052528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647e0e-47fd-47d5-9314-f57c55fc22f4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.060442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 779/1572] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:21 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.061602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aab522-e89d-4fe9-9877-acf7947c1ada admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.068176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647e0e-47fd-47d5-9314-f57c55fc22f4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.124503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aab522-e89d-4fe9-9877-acf7947c1ada admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.126855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15af7b-bd80-4a79-869c-4c4723571900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.127502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15af7b-bd80-4a79-869c-4c4723571900 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.127781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15af7b-bd80-4a79-869c-4c4723571900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.128051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15af7b-bd80-4a79-869c-4c4723571900 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.128720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15af7b-bd80-4a79-869c-4c4723571900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.129181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f2c96-94ca-41c7-bf93-4e9191569da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.129793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2c96-94ca-41c7-bf93-4e9191569da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.130061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2c96-94ca-41c7-bf93-4e9191569da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.130350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2c96-94ca-41c7-bf93-4e9191569da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.130656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15af7b-bd80-4a79-869c-4c4723571900 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.131597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2c96-94ca-41c7-bf93-4e9191569da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:22.131895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2c96-94ca-41c7-bf93-4e9191569da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.133467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2c96-94ca-41c7-bf93-4e9191569da0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.137211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:22.152288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 780/1573] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:22.152288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc748d-bf87-4ce5-b04b-b98cffdb0f1d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.152288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc748d-bf87-4ce5-b04b-b98cffdb0f1d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.152288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc748d-bf87-4ce5-b04b-b98cffdb0f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.161740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 794/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.162755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15af7b-bd80-4a79-869c-4c4723571900 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.167133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-49bc748d-bf87-4ce5-b04b-b98cffdb0f1d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:22.168355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-49bc748d-bf87-4ce5-b04b-b98cffdb0f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:22.231476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 781/1575] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:22.234807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc748d-bf87-4ce5-b04b-b98cffdb0f1d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.242915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc748d-bf87-4ce5-b04b-b98cffdb0f1d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.244551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15af7b-bd80-4a79-869c-4c4723571900 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.247907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94743136-1589-4de6-904a-b88b00e616f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.248489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94743136-1589-4de6-904a-b88b00e616f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.248770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94743136-1589-4de6-904a-b88b00e616f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.249038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94743136-1589-4de6-904a-b88b00e616f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.249704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94743136-1589-4de6-904a-b88b00e616f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.250062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb2cfe-eaaf-4b19-93d1-4250ef08f278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.250706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb2cfe-eaaf-4b19-93d1-4250ef08f278 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.251042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb2cfe-eaaf-4b19-93d1-4250ef08f278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.251315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb2cfe-eaaf-4b19-93d1-4250ef08f278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.251667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94743136-1589-4de6-904a-b88b00e616f1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.252022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb2cfe-eaaf-4b19-93d1-4250ef08f278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.253684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb2cfe-eaaf-4b19-93d1-4250ef08f278 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.266415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 795/1576] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.267403 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb2cfe-eaaf-4b19-93d1-4250ef08f278 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.278242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 782/1577] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.278242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94743136-1589-4de6-904a-b88b00e616f1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.278513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb2cfe-eaaf-4b19-93d1-4250ef08f278 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.282737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db803e4d-44e8-4e5b-9064-c82db23ef220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.283364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db803e4d-44e8-4e5b-9064-c82db23ef220 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.283646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db803e4d-44e8-4e5b-9064-c82db23ef220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.283915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db803e4d-44e8-4e5b-9064-c82db23ef220 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.284655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db803e4d-44e8-4e5b-9064-c82db23ef220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.286568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db803e4d-44e8-4e5b-9064-c82db23ef220 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.289171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94743136-1589-4de6-904a-b88b00e616f1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.296357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a00c1-1123-4591-a6db-5824b271d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.296814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a00c1-1123-4591-a6db-5824b271d1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.297034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a00c1-1123-4591-a6db-5824b271d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.297239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a00c1-1123-4591-a6db-5824b271d1f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.298020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a00c1-1123-4591-a6db-5824b271d1f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.300117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a00c1-1123-4591-a6db-5824b271d1f3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.309648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 796/1578] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.310275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db803e4d-44e8-4e5b-9064-c82db23ef220 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.320056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db803e4d-44e8-4e5b-9064-c82db23ef220 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.325144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1f81e-6634-433d-abb0-4a29088e1269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.325923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1f81e-6634-433d-abb0-4a29088e1269 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.326203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1f81e-6634-433d-abb0-4a29088e1269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.326472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1f81e-6634-433d-abb0-4a29088e1269 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.327167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1f81e-6634-433d-abb0-4a29088e1269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.329085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1f81e-6634-433d-abb0-4a29088e1269 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.329291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 783/1579] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.330097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a00c1-1123-4591-a6db-5824b271d1f3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.352608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 797/1580] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.353444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1f81e-6634-433d-abb0-4a29088e1269 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.363385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1f81e-6634-433d-abb0-4a29088e1269 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.388169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:22.401358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a00c1-1123-4591-a6db-5824b271d1f3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.406091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232de1a-bd83-489d-a7bd-22338f74cffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.406791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232de1a-bd83-489d-a7bd-22338f74cffb admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.407235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232de1a-bd83-489d-a7bd-22338f74cffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.407515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232de1a-bd83-489d-a7bd-22338f74cffb admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.408191 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232de1a-bd83-489d-a7bd-22338f74cffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.410214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232de1a-bd83-489d-a7bd-22338f74cffb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.420763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7cadd-b6ed-4289-ae9f-c6cb5e62a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.421391 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7cadd-b6ed-4289-ae9f-c6cb5e62a21c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.421956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7cadd-b6ed-4289-ae9f-c6cb5e62a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.422073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7cadd-b6ed-4289-ae9f-c6cb5e62a21c admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.422670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7cadd-b6ed-4289-ae9f-c6cb5e62a21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.424677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7cadd-b6ed-4289-ae9f-c6cb5e62a21c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.444347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 784/1581] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.444347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232de1a-bd83-489d-a7bd-22338f74cffb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.452806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 798/1582] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.457011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7cadd-b6ed-4289-ae9f-c6cb5e62a21c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.466790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7cadd-b6ed-4289-ae9f-c6cb5e62a21c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.504065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232de1a-bd83-489d-a7bd-22338f74cffb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.506775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:22.507892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56376019-1555-4e3d-b61c-0348eb496d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.508885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56376019-1555-4e3d-b61c-0348eb496d9b service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.509403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56376019-1555-4e3d-b61c-0348eb496d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.509845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56376019-1555-4e3d-b61c-0348eb496d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.533048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092f864-e588-4cd9-92d0-05729eef279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.533594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092f864-e588-4cd9-92d0-05729eef279d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.533872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092f864-e588-4cd9-92d0-05729eef279d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.534146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092f864-e588-4cd9-92d0-05729eef279d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.534848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092f864-e588-4cd9-92d0-05729eef279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.536497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092f864-e588-4cd9-92d0-05729eef279d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.547662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 799/1583] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.551599 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092f864-e588-4cd9-92d0-05729eef279d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.562356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092f864-e588-4cd9-92d0-05729eef279d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.567258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc2b0b-43c9-499e-b94f-ff73f3bbcf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.567862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc2b0b-43c9-499e-b94f-ff73f3bbcf28 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.568201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc2b0b-43c9-499e-b94f-ff73f3bbcf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.568478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc2b0b-43c9-499e-b94f-ff73f3bbcf28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.569164 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc2b0b-43c9-499e-b94f-ff73f3bbcf28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.570760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc2b0b-43c9-499e-b94f-ff73f3bbcf28 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.574933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56376019-1555-4e3d-b61c-0348eb496d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.576372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56376019-1555-4e3d-b61c-0348eb496d9b service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.580586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 800/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.581375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc2b0b-43c9-499e-b94f-ff73f3bbcf28 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.588650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 785/1585] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:22.589429 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56376019-1555-4e3d-b61c-0348eb496d9b service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.591218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc2b0b-43c9-499e-b94f-ff73f3bbcf28 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.595883 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86af8-dd66-4d58-aeb2-896ccf397ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.596484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86af8-dd66-4d58-aeb2-896ccf397ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.596765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86af8-dd66-4d58-aeb2-896ccf397ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.597047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86af8-dd66-4d58-aeb2-896ccf397ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.597794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e86af8-dd66-4d58-aeb2-896ccf397ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.600147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56376019-1555-4e3d-b61c-0348eb496d9b service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.600299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e86af8-dd66-4d58-aeb2-896ccf397ac9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.606021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19447-2c64-4ae6-b324-f50079238d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.606730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19447-2c64-4ae6-b324-f50079238d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.606865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19447-2c64-4ae6-b324-f50079238d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.607079 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19447-2c64-4ae6-b324-f50079238d69 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.607740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb19447-2c64-4ae6-b324-f50079238d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.609920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb19447-2c64-4ae6-b324-f50079238d69 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.613110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 801/1586] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.613110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86af8-dd66-4d58-aeb2-896ccf397ac9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.625748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86af8-dd66-4d58-aeb2-896ccf397ac9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.631543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8d7e6-441b-4771-8209-698adf78b43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.632166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8d7e6-441b-4771-8209-698adf78b43b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.632468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8d7e6-441b-4771-8209-698adf78b43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.632789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8d7e6-441b-4771-8209-698adf78b43b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.633479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8d7e6-441b-4771-8209-698adf78b43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.635157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8d7e6-441b-4771-8209-698adf78b43b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.639859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 786/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.639859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19447-2c64-4ae6-b324-f50079238d69 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.650299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 802/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.650299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8d7e6-441b-4771-8209-698adf78b43b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.657063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19447-2c64-4ae6-b324-f50079238d69 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.658451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8d7e6-441b-4771-8209-698adf78b43b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.662547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5da3-f6a9-4b78-9f4f-0383190c3746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.663488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5da3-f6a9-4b78-9f4f-0383190c3746 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.663631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5da3-f6a9-4b78-9f4f-0383190c3746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.663957 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5da3-f6a9-4b78-9f4f-0383190c3746 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.664360 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40741716-8450-4ea0-8577-49873ba6e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.664647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d5da3-f6a9-4b78-9f4f-0383190c3746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.665229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40741716-8450-4ea0-8577-49873ba6e488 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.665517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40741716-8450-4ea0-8577-49873ba6e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.665790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40741716-8450-4ea0-8577-49873ba6e488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.666493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40741716-8450-4ea0-8577-49873ba6e488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.666603 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d5da3-f6a9-4b78-9f4f-0383190c3746 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.668133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40741716-8450-4ea0-8577-49873ba6e488 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.681605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 803/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.682408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40741716-8450-4ea0-8577-49873ba6e488 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.695833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 787/1590] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:22.695833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5da3-f6a9-4b78-9f4f-0383190c3746 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.696155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40741716-8450-4ea0-8577-49873ba6e488 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.701701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa77b-4da8-4676-aa59-704d501163dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.702379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa77b-4da8-4676-aa59-704d501163dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.702662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa77b-4da8-4676-aa59-704d501163dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.702971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa77b-4da8-4676-aa59-704d501163dc admin admin] PATH_INFO: `/v3/projects/6af1561d33e144caa9188e64b9d3d214/users/c11a3e219b4b43b9b56b9a7c3207b895/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.704458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5da3-f6a9-4b78-9f4f-0383190c3746 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.715260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d0acb-d586-4e83-905c-b15f7fd40b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.715903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d0acb-d586-4e83-905c-b15f7fd40b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.716173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d0acb-d586-4e83-905c-b15f7fd40b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.716484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d0acb-d586-4e83-905c-b15f7fd40b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.717430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d0acb-d586-4e83-905c-b15f7fd40b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.719077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d0acb-d586-4e83-905c-b15f7fd40b04 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.720633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fa77b-4da8-4676-aa59-704d501163dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af1561d33e144caa9188e64b9d3d214, user_id=c11a3e219b4b43b9b56b9a7c3207b895, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.723435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fa77b-4da8-4676-aa59-704d501163dc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.731143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 788/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.731917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d0acb-d586-4e83-905c-b15f7fd40b04 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.750029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 804/1592] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:22 2022] PUT /identity/v3/projects/6af1561d33e144caa9188e64b9d3d214/users/c11a3e219b4b43b9b56b9a7c3207b895/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:22.750029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa77b-4da8-4676-aa59-704d501163dc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.750372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d0acb-d586-4e83-905c-b15f7fd40b04 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.808469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:22.836096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ccd6a-5fe9-4fd7-a36c-8604e0040edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.837170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ccd6a-5fe9-4fd7-a36c-8604e0040edd admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.837681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ccd6a-5fe9-4fd7-a36c-8604e0040edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.838153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ccd6a-5fe9-4fd7-a36c-8604e0040edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.839928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa77b-4da8-4676-aa59-704d501163dc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.840415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ccd6a-5fe9-4fd7-a36c-8604e0040edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.847518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ccd6a-5fe9-4fd7-a36c-8604e0040edd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.851925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6272-6404-47f6-87a9-3cd14c2d6321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.852751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6272-6404-47f6-87a9-3cd14c2d6321 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.853137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6272-6404-47f6-87a9-3cd14c2d6321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.853483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6272-6404-47f6-87a9-3cd14c2d6321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.854325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c6272-6404-47f6-87a9-3cd14c2d6321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.856575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c6272-6404-47f6-87a9-3cd14c2d6321 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.859763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 789/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.860685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ccd6a-5fe9-4fd7-a36c-8604e0040edd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.871257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 805/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.871665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ccd6a-5fe9-4fd7-a36c-8604e0040edd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.872782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6272-6404-47f6-87a9-3cd14c2d6321 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.878552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226aa74-a5e9-4d40-835a-8a9ff6b03c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.879416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226aa74-a5e9-4d40-835a-8a9ff6b03c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.879885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226aa74-a5e9-4d40-835a-8a9ff6b03c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.880256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226aa74-a5e9-4d40-835a-8a9ff6b03c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.881126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226aa74-a5e9-4d40-835a-8a9ff6b03c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.882868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226aa74-a5e9-4d40-835a-8a9ff6b03c5c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.887100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6272-6404-47f6-87a9-3cd14c2d6321 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.893845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f508-7056-4b63-8e21-daa3e4e4f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.894254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 790/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.894977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f508-7056-4b63-8e21-daa3e4e4f00f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.895268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f508-7056-4b63-8e21-daa3e4e4f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.895552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f508-7056-4b63-8e21-daa3e4e4f00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.896788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159f508-7056-4b63-8e21-daa3e4e4f00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.898949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226aa74-a5e9-4d40-835a-8a9ff6b03c5c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.899291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159f508-7056-4b63-8e21-daa3e4e4f00f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.911480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226aa74-a5e9-4d40-835a-8a9ff6b03c5c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.914750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 806/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.915765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f508-7056-4b63-8e21-daa3e4e4f00f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.917207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e77ed-24ea-4411-9a29-542f9300b739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.917945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e77ed-24ea-4411-9a29-542f9300b739 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.918327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e77ed-24ea-4411-9a29-542f9300b739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.918722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e77ed-24ea-4411-9a29-542f9300b739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.919574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e77ed-24ea-4411-9a29-542f9300b739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.921461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e77ed-24ea-4411-9a29-542f9300b739 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.927345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f508-7056-4b63-8e21-daa3e4e4f00f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:22.932535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b951d49-58e0-4299-b44e-2f292429211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:22.933485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b951d49-58e0-4299-b44e-2f292429211c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.933944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b951d49-58e0-4299-b44e-2f292429211c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.934416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b951d49-58e0-4299-b44e-2f292429211c admin admin] PATH_INFO: `/v3/projects/4bcb60ba6e13498a988439731d377f1f/users/7d1d9ff09ca94ef880c30452b1f247ff/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.934676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 791/1597] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:22.939184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8122f-3dea-4d6a-a150-708aff17714c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:22.939610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8122f-3dea-4d6a-a150-708aff17714c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:22.939889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8122f-3dea-4d6a-a150-708aff17714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:22.953954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b951d49-58e0-4299-b44e-2f292429211c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcb60ba6e13498a988439731d377f1f, user_id=7d1d9ff09ca94ef880c30452b1f247ff, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:22.956699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b951d49-58e0-4299-b44e-2f292429211c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:22.979893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 807/1598] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:22 2022] PUT /identity/v3/projects/4bcb60ba6e13498a988439731d377f1f/users/7d1d9ff09ca94ef880c30452b1f247ff/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:22.980838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b951d49-58e0-4299-b44e-2f292429211c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:22.983497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-99b8122f-3dea-4d6a-a150-708aff17714c None None] MFA Rules not processed for user `c11a3e219b4b43b9b56b9a7c3207b895`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:22.984772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-99b8122f-3dea-4d6a-a150-708aff17714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:23.025436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:23.072329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 792/1599] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:23.073433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8122f-3dea-4d6a-a150-708aff17714c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.074630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b951d49-58e0-4299-b44e-2f292429211c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.080863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960c25-46fa-496e-aa76-ab74eab6a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.082327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960c25-46fa-496e-aa76-ab74eab6a94a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.083296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960c25-46fa-496e-aa76-ab74eab6a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.083609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7960c25-46fa-496e-aa76-ab74eab6a94a admin admin] PATH_INFO: `/v3/projects/690822c00bf34b2d90eee3e2026c78fb/users/eb3d3ca2457b47a29b7c94bd8be450cd/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.087209 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8122f-3dea-4d6a-a150-708aff17714c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.092336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb31ae-6bfa-4fe4-9e38-8ebcd1523ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.093034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb31ae-6bfa-4fe4-9e38-8ebcd1523ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.093323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb31ae-6bfa-4fe4-9e38-8ebcd1523ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.093665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb31ae-6bfa-4fe4-9e38-8ebcd1523ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.094387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb31ae-6bfa-4fe4-9e38-8ebcd1523ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.096110 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb31ae-6bfa-4fe4-9e38-8ebcd1523ecc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.100985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7960c25-46fa-496e-aa76-ab74eab6a94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=690822c00bf34b2d90eee3e2026c78fb, user_id=eb3d3ca2457b47a29b7c94bd8be450cd, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.103724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7960c25-46fa-496e-aa76-ab74eab6a94a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.108209 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 793/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:23.112046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb31ae-6bfa-4fe4-9e38-8ebcd1523ecc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.120734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 808/1601] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:22 2022] PUT /identity/v3/projects/690822c00bf34b2d90eee3e2026c78fb/users/eb3d3ca2457b47a29b7c94bd8be450cd/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:23.121767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960c25-46fa-496e-aa76-ab74eab6a94a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.127564 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb31ae-6bfa-4fe4-9e38-8ebcd1523ecc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.196124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5454c-ce2b-4bc8-9aed-993b9d36036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.196819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5454c-ce2b-4bc8-9aed-993b9d36036d admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.197119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5454c-ce2b-4bc8-9aed-993b9d36036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.197373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5454c-ce2b-4bc8-9aed-993b9d36036d admin admin] PATH_INFO: `/v3/projects/81e9270b6ae24d75b778de7e0ade50fc/users/be2d0a6b52c8465a8ae2f46d1270ae38/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.199411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7960c25-46fa-496e-aa76-ab74eab6a94a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.205702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d995b-6723-44ad-acb9-4f952624995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.206939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d995b-6723-44ad-acb9-4f952624995c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.207229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d995b-6723-44ad-acb9-4f952624995c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.207994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d995b-6723-44ad-acb9-4f952624995c admin admin] PATH_INFO: `/v3/projects/c8e43fa41dc8445abed15accf9163b32/users/cb1cee30bc59446d882880d978b78bc2/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.212830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5454c-ce2b-4bc8-9aed-993b9d36036d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e9270b6ae24d75b778de7e0ade50fc, user_id=be2d0a6b52c8465a8ae2f46d1270ae38, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.215680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5454c-ce2b-4bc8-9aed-993b9d36036d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.227502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d995b-6723-44ad-acb9-4f952624995c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e43fa41dc8445abed15accf9163b32, user_id=cb1cee30bc59446d882880d978b78bc2, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.230213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d995b-6723-44ad-acb9-4f952624995c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.237340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 794/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:23 2022] PUT /identity/v3/projects/81e9270b6ae24d75b778de7e0ade50fc/users/be2d0a6b52c8465a8ae2f46d1270ae38/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:23.237340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5454c-ce2b-4bc8-9aed-993b9d36036d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.252530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 809/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:23 2022] PUT /identity/v3/projects/c8e43fa41dc8445abed15accf9163b32/users/cb1cee30bc59446d882880d978b78bc2/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:23.253961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba137-691c-4946-8ede-8a122be1d579 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.254307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba137-691c-4946-8ede-8a122be1d579 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.254589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba137-691c-4946-8ede-8a122be1d579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.259743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:23.285922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8b2ba137-691c-4946-8ede-8a122be1d579 None None] MFA Rules not processed for user `7d1d9ff09ca94ef880c30452b1f247ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:23.287721 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8b2ba137-691c-4946-8ede-8a122be1d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:23.309910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5454c-ce2b-4bc8-9aed-993b9d36036d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.364450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 810/1604] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:23.365501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba137-691c-4946-8ede-8a122be1d579 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.388739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b41cf-0808-402b-aee2-48f1b4a7a4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.390016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b41cf-0808-402b-aee2-48f1b4a7a4df admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.390439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b41cf-0808-402b-aee2-48f1b4a7a4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.390729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b41cf-0808-402b-aee2-48f1b4a7a4df admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.391517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b41cf-0808-402b-aee2-48f1b4a7a4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.394134 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b41cf-0808-402b-aee2-48f1b4a7a4df admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.401116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:23.410958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 795/1605] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:23.411666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b41cf-0808-402b-aee2-48f1b4a7a4df admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.429303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b41cf-0808-402b-aee2-48f1b4a7a4df admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.435012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa99c1-46f2-4865-8375-2aaee2961ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.435698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa99c1-46f2-4865-8375-2aaee2961ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.435979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa99c1-46f2-4865-8375-2aaee2961ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.436255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa99c1-46f2-4865-8375-2aaee2961ea4 admin admin] PATH_INFO: `/v3/projects/1cabcb825ebe4430a7ffa759d5e53d2f/users/df8fb928aa42413b9d03e83f46dd48bc/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.450463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba137-691c-4946-8ede-8a122be1d579 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.456326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bd505-7b6a-43ea-8213-5773dfb14553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.457253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bd505-7b6a-43ea-8213-5773dfb14553 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.457512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa99c1-46f2-4865-8375-2aaee2961ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cabcb825ebe4430a7ffa759d5e53d2f, user_id=df8fb928aa42413b9d03e83f46dd48bc, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.457650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bd505-7b6a-43ea-8213-5773dfb14553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.457892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bd505-7b6a-43ea-8213-5773dfb14553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.458807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bd505-7b6a-43ea-8213-5773dfb14553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.461243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa99c1-46f2-4865-8375-2aaee2961ea4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.461710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bd505-7b6a-43ea-8213-5773dfb14553 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.480759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 796/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:23 2022] PUT /identity/v3/projects/1cabcb825ebe4430a7ffa759d5e53d2f/users/df8fb928aa42413b9d03e83f46dd48bc/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:23.481399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aaab4-73e0-46c2-a120-4ad32286645d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.481689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aaab4-73e0-46c2-a120-4ad32286645d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.481989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aaab4-73e0-46c2-a120-4ad32286645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.501497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 811/1607] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:23 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:23.503614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039ad7a-589d-4929-9727-efaaf459bbbb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.503902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ca2aaab4-73e0-46c2-a120-4ad32286645d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:23.504474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039ad7a-589d-4929-9727-efaaf459bbbb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.505183 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039ad7a-589d-4929-9727-efaaf459bbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.505317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ca2aaab4-73e0-46c2-a120-4ad32286645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:23.531238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d039ad7a-589d-4929-9727-efaaf459bbbb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:23.532832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d039ad7a-589d-4929-9727-efaaf459bbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:23.574304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 797/1608] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:23.575821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d76f-8405-43dd-a0f4-3ae10d62682f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.576108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d76f-8405-43dd-a0f4-3ae10d62682f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.576383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d76f-8405-43dd-a0f4-3ae10d62682f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.597717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2dd8d76f-8405-43dd-a0f4-3ae10d62682f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:23.599459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2dd8d76f-8405-43dd-a0f4-3ae10d62682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:23.608754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 812/1609] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:23.609852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039ad7a-589d-4929-9727-efaaf459bbbb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.613395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 798/1610] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:23.614308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d76f-8405-43dd-a0f4-3ae10d62682f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.625065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d76f-8405-43dd-a0f4-3ae10d62682f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.630345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9065cf3-6b72-4b5f-94cf-5bfd36e05600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.631319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065cf3-6b72-4b5f-94cf-5bfd36e05600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.631601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065cf3-6b72-4b5f-94cf-5bfd36e05600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.631870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065cf3-6b72-4b5f-94cf-5bfd36e05600 admin admin] PATH_INFO: `/v3/projects/601417033ad54e309a08ecd1bb50e83c/users/3360b5960eaa4f14a6fbb8f10b74e85e/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.648038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9065cf3-6b72-4b5f-94cf-5bfd36e05600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=601417033ad54e309a08ecd1bb50e83c, user_id=3360b5960eaa4f14a6fbb8f10b74e85e, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.650739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9065cf3-6b72-4b5f-94cf-5bfd36e05600 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.678468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 799/1611] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:23 2022] PUT /identity/v3/projects/601417033ad54e309a08ecd1bb50e83c/users/3360b5960eaa4f14a6fbb8f10b74e85e/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:23.678468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6fbb2-e029-4c46-a7a2-428033511635 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.678468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6fbb2-e029-4c46-a7a2-428033511635 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.678468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6fbb2-e029-4c46-a7a2-428033511635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.698357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:23.704858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-54b6fbb2-e029-4c46-a7a2-428033511635 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:23.707166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-54b6fbb2-e029-4c46-a7a2-428033511635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:23.718002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039ad7a-589d-4929-9727-efaaf459bbbb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.790940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 800/1612] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:23.791775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b1bd8-d910-43ff-8fac-b3393c1a93df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.791974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6fbb2-e029-4c46-a7a2-428033511635 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.793065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b1bd8-d910-43ff-8fac-b3393c1a93df service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.801704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b1bd8-d910-43ff-8fac-b3393c1a93df service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.802293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b1bd8-d910-43ff-8fac-b3393c1a93df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.804739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6fbb2-e029-4c46-a7a2-428033511635 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.810197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99a228-f028-42ec-a659-84bd87289bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.811011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99a228-f028-42ec-a659-84bd87289bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.811371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99a228-f028-42ec-a659-84bd87289bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.811595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99a228-f028-42ec-a659-84bd87289bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.813198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99a228-f028-42ec-a659-84bd87289bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.815965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99a228-f028-42ec-a659-84bd87289bf0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.831128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:23.855118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 801/1613] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:23 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:23.855118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99a228-f028-42ec-a659-84bd87289bf0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.897887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b1bd8-d910-43ff-8fac-b3393c1a93df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.900454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b1bd8-d910-43ff-8fac-b3393c1a93df service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.914419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 813/1614] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:23.915466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b1bd8-d910-43ff-8fac-b3393c1a93df service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.924822 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99a228-f028-42ec-a659-84bd87289bf0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.927093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b1bd8-d910-43ff-8fac-b3393c1a93df service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.929382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6701298-80ac-45af-8379-18932d187379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.930111 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701298-80ac-45af-8379-18932d187379 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.930468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701298-80ac-45af-8379-18932d187379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.930813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701298-80ac-45af-8379-18932d187379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.932620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a85e3-f740-4458-8d40-0ba0e28aff80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.933346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a85e3-f740-4458-8d40-0ba0e28aff80 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.933742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a85e3-f740-4458-8d40-0ba0e28aff80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.933952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a85e3-f740-4458-8d40-0ba0e28aff80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.946060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a85e3-f740-4458-8d40-0ba0e28aff80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.948313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a85e3-f740-4458-8d40-0ba0e28aff80 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.957072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6701298-80ac-45af-8379-18932d187379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.960699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6701298-80ac-45af-8379-18932d187379 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.961978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 814/1615] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:23.962709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a85e3-f740-4458-8d40-0ba0e28aff80 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:23.971425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a85e3-f740-4458-8d40-0ba0e28aff80 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:23.976714 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccd602-d1ee-4090-afd3-7a16c0ff326a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:23.977334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccd602-d1ee-4090-afd3-7a16c0ff326a service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:23.977780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccd602-d1ee-4090-afd3-7a16c0ff326a service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:23.978089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccd602-d1ee-4090-afd3-7a16c0ff326a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:23.991714 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccd602-d1ee-4090-afd3-7a16c0ff326a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:23.993314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccd602-d1ee-4090-afd3-7a16c0ff326a service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:23.998981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 802/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:24.003770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a028b41-8e6c-4cd8-b47d-1a94d5609458 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.004344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a028b41-8e6c-4cd8-b47d-1a94d5609458 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.006559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 815/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:24.007252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a028b41-8e6c-4cd8-b47d-1a94d5609458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.007459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccd602-d1ee-4090-afd3-7a16c0ff326a service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.016512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccd602-d1ee-4090-afd3-7a16c0ff326a service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:24.021083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35d19-e0c0-40b9-a7c3-11d5d76f2438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:24.021918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35d19-e0c0-40b9-a7c3-11d5d76f2438 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.022254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35d19-e0c0-40b9-a7c3-11d5d76f2438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.022536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35d19-e0c0-40b9-a7c3-11d5d76f2438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.034690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35d19-e0c0-40b9-a7c3-11d5d76f2438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:24.036280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35d19-e0c0-40b9-a7c3-11d5d76f2438 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:24.050146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 816/1618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:24.050921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35d19-e0c0-40b9-a7c3-11d5d76f2438 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.065589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35d19-e0c0-40b9-a7c3-11d5d76f2438 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:24.072002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b6b7-c593-4dbc-8247-0ea94242fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:24.072634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b6b7-c593-4dbc-8247-0ea94242fe06 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.072919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b6b7-c593-4dbc-8247-0ea94242fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.073192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b6b7-c593-4dbc-8247-0ea94242fe06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.073900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78b6b7-c593-4dbc-8247-0ea94242fe06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:24.075771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78b6b7-c593-4dbc-8247-0ea94242fe06 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:24.080762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7a028b41-8e6c-4cd8-b47d-1a94d5609458 None None] MFA Rules not processed for user `3360b5960eaa4f14a6fbb8f10b74e85e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:24.083651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7a028b41-8e6c-4cd8-b47d-1a94d5609458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:24.088231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 817/1619] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:24.092211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b6b7-c593-4dbc-8247-0ea94242fe06 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.106284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b6b7-c593-4dbc-8247-0ea94242fe06 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:24.112814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb92fc-7772-4dbf-b0b4-cda4dc396f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:24.114508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb92fc-7772-4dbf-b0b4-cda4dc396f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.115411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb92fc-7772-4dbf-b0b4-cda4dc396f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.116212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb92fc-7772-4dbf-b0b4-cda4dc396f13 admin admin] PATH_INFO: `/v3/projects/9ff53dcba5ba4d638f6bcb1579eb845a/users/f5556dc3e9c54a1faec1cc91d4a4f5c9/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.175797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb92fc-7772-4dbf-b0b4-cda4dc396f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff53dcba5ba4d638f6bcb1579eb845a, user_id=f5556dc3e9c54a1faec1cc91d4a4f5c9, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:24.184520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb92fc-7772-4dbf-b0b4-cda4dc396f13 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:24.215019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 803/1620] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:24.215961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 818/1621] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:24 2022] PUT /identity/v3/projects/9ff53dcba5ba4d638f6bcb1579eb845a/users/f5556dc3e9c54a1faec1cc91d4a4f5c9/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:49:24.219688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a028b41-8e6c-4cd8-b47d-1a94d5609458 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.220141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb92fc-7772-4dbf-b0b4-cda4dc396f13 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.239436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a028b41-8e6c-4cd8-b47d-1a94d5609458 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:24.284883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:24.326378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb92fc-7772-4dbf-b0b4-cda4dc396f13 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:24.344327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0263e81-d82f-497e-bf21-697e1b79ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:24.345953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263e81-d82f-497e-bf21-697e1b79ce1e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.346515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263e81-d82f-497e-bf21-697e1b79ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.346515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263e81-d82f-497e-bf21-697e1b79ce1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.347242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0263e81-d82f-497e-bf21-697e1b79ce1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:24.352979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0263e81-d82f-497e-bf21-697e1b79ce1e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:24.382610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 819/1622] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:49:24.384622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5af3ee-5c11-4028-aa67-e0bf50fae14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:24.387121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0263e81-d82f-497e-bf21-697e1b79ce1e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.390291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5af3ee-5c11-4028-aa67-e0bf50fae14e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.390625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5af3ee-5c11-4028-aa67-e0bf50fae14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.390944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5af3ee-5c11-4028-aa67-e0bf50fae14e admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.391659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5af3ee-5c11-4028-aa67-e0bf50fae14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:24.396079 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5af3ee-5c11-4028-aa67-e0bf50fae14e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:24.406584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0263e81-d82f-497e-bf21-697e1b79ce1e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:24.418407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f3dc-3b6e-4e11-a096-7f9258df8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:24.425459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f3dc-3b6e-4e11-a096-7f9258df8e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.425832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f3dc-3b6e-4e11-a096-7f9258df8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.426124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f3dc-3b6e-4e11-a096-7f9258df8e67 admin admin] PATH_INFO: `/v3/projects/9ff53dcba5ba4d638f6bcb1579eb845a/users/f5556dc3e9c54a1faec1cc91d4a4f5c9/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.430660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072f3dc-3b6e-4e11-a096-7f9258df8e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff53dcba5ba4d638f6bcb1579eb845a, user_id=f5556dc3e9c54a1faec1cc91d4a4f5c9, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:24.436988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072f3dc-3b6e-4e11-a096-7f9258df8e67 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:24.462420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 820/1623] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:24 2022] PUT /identity/v3/projects/9ff53dcba5ba4d638f6bcb1579eb845a/users/f5556dc3e9c54a1faec1cc91d4a4f5c9/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:24.467996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 804/1624] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:24 2022] POST /identity/v3/projects => generated 405 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:24.475454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f3dc-3b6e-4e11-a096-7f9258df8e67 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.478724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8de9d-0173-4b07-8976-a535e03d25a0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.479588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8de9d-0173-4b07-8976-a535e03d25a0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.480447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8de9d-0173-4b07-8976-a535e03d25a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.562425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:24.576852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-37f8de9d-0173-4b07-8976-a535e03d25a0 None None] MFA Rules not processed for user `f5556dc3e9c54a1faec1cc91d4a4f5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:24.581508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-37f8de9d-0173-4b07-8976-a535e03d25a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:24.648497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f3dc-3b6e-4e11-a096-7f9258df8e67 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:24.723377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 805/1625] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:24.739784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8de9d-0173-4b07-8976-a535e03d25a0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.799801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682ccd4-abc8-40ee-bc3d-7f5db7debe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:24.801066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682ccd4-abc8-40ee-bc3d-7f5db7debe4c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.801580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682ccd4-abc8-40ee-bc3d-7f5db7debe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.802806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682ccd4-abc8-40ee-bc3d-7f5db7debe4c admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.804521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682ccd4-abc8-40ee-bc3d-7f5db7debe4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:24.811953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682ccd4-abc8-40ee-bc3d-7f5db7debe4c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:24.852156 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 821/1626] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:24 2022] POST /identity/v3/users => generated 309 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:24.857701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682ccd4-abc8-40ee-bc3d-7f5db7debe4c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.887461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682ccd4-abc8-40ee-bc3d-7f5db7debe4c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:24.903104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eafc6-b3d1-4458-af9c-a56e0ddeb3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:24.903825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eafc6-b3d1-4458-af9c-a56e0ddeb3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.904113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eafc6-b3d1-4458-af9c-a56e0ddeb3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.904774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8de9d-0173-4b07-8976-a535e03d25a0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:24.905533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eafc6-b3d1-4458-af9c-a56e0ddeb3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.906703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147eafc6-b3d1-4458-af9c-a56e0ddeb3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:24.980257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f5e30-da44-4978-9a87-3ff20623bbe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:24.980257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f5e30-da44-4978-9a87-3ff20623bbe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:24.991632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147eafc6-b3d1-4458-af9c-a56e0ddeb3d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:24.992101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f5e30-da44-4978-9a87-3ff20623bbe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:24.992101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f5e30-da44-4978-9a87-3ff20623bbe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:24.992101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f5e30-da44-4978-9a87-3ff20623bbe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:24.992101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f5e30-da44-4978-9a87-3ff20623bbe9 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:24.992569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 822/1627] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:24.992569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eafc6-b3d1-4458-af9c-a56e0ddeb3d9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:24.992754 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 806/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:25.019476 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eafc6-b3d1-4458-af9c-a56e0ddeb3d9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:25.037961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81b981-2608-474f-8865-2109fe2bce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:25.038522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81b981-2608-474f-8865-2109fe2bce37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:25.038809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81b981-2608-474f-8865-2109fe2bce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:25.039112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81b981-2608-474f-8865-2109fe2bce37 admin admin] PATH_INFO: `/v3/projects/23b78652fdcf48658021c784af2f0a79/users/c565ab184b43405bb3652acb4d1e610e/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:25.085503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81b981-2608-474f-8865-2109fe2bce37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b78652fdcf48658021c784af2f0a79, user_id=c565ab184b43405bb3652acb4d1e610e, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:25.088675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81b981-2608-474f-8865-2109fe2bce37 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:25.118034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 823/1629] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:24 2022] PUT /identity/v3/projects/23b78652fdcf48658021c784af2f0a79/users/c565ab184b43405bb3652acb4d1e610e/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:25.121973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f5e30-da44-4978-9a87-3ff20623bbe9 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:25.138390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f5e30-da44-4978-9a87-3ff20623bbe9 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:25.230355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:25.291567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15e24d-4fd5-490b-8d40-16bc4ff32637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:25.292273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15e24d-4fd5-490b-8d40-16bc4ff32637 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:25.292558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15e24d-4fd5-490b-8d40-16bc4ff32637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:25.292835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15e24d-4fd5-490b-8d40-16bc4ff32637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:25.294797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15e24d-4fd5-490b-8d40-16bc4ff32637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:25.298723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15e24d-4fd5-490b-8d40-16bc4ff32637 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:25.329574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 807/1630] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:25.330259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81b981-2608-474f-8865-2109fe2bce37 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:25.347739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81b981-2608-474f-8865-2109fe2bce37 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:25.369371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bd29f-e9af-4eb6-adad-3a1d8077032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:25.370068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bd29f-e9af-4eb6-adad-3a1d8077032f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:25.370350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bd29f-e9af-4eb6-adad-3a1d8077032f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:25.370627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bd29f-e9af-4eb6-adad-3a1d8077032f admin admin] PATH_INFO: `/v3/projects/23b78652fdcf48658021c784af2f0a79/users/c565ab184b43405bb3652acb4d1e610e/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:25.372950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bd29f-e9af-4eb6-adad-3a1d8077032f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b78652fdcf48658021c784af2f0a79, user_id=c565ab184b43405bb3652acb4d1e610e, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:25.375849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bd29f-e9af-4eb6-adad-3a1d8077032f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:25.397615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 824/1631] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:25 2022] PUT /identity/v3/projects/23b78652fdcf48658021c784af2f0a79/users/c565ab184b43405bb3652acb4d1e610e/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:49:25.408489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc07bf-a0b3-4bd3-ba1c-ece3d5f28237 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:25.408818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc07bf-a0b3-4bd3-ba1c-ece3d5f28237 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:25.409045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc07bf-a0b3-4bd3-ba1c-ece3d5f28237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:25.481966 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b2bc07bf-a0b3-4bd3-ba1c-ece3d5f28237 None None] MFA Rules not processed for user `c565ab184b43405bb3652acb4d1e610e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:25.484339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b2bc07bf-a0b3-4bd3-ba1c-ece3d5f28237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:25.711442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 808/1632] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:25.734281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bd29f-e9af-4eb6-adad-3a1d8077032f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:25.815567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc07bf-a0b3-4bd3-ba1c-ece3d5f28237 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:25.848751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bd29f-e9af-4eb6-adad-3a1d8077032f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:25.856781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fb7a6-93fe-4fde-a9c2-0e466324f3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:25.858411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fb7a6-93fe-4fde-a9c2-0e466324f3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:25.858826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fb7a6-93fe-4fde-a9c2-0e466324f3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:25.859339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fb7a6-93fe-4fde-a9c2-0e466324f3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:25.892184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fb7a6-93fe-4fde-a9c2-0e466324f3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:25.894936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fb7a6-93fe-4fde-a9c2-0e466324f3f0 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:25.913661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 825/1633] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:25 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:25.914414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc07bf-a0b3-4bd3-ba1c-ece3d5f28237 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:25.923227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:25.923762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:25.924042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:25.924442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] PATH_INFO: `/v3/users/c11a3e219b4b43b9b56b9a7c3207b895` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:25.925612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11a3e219b4b43b9b56b9a7c3207b895)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:25.927243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:49:25.927243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jul 27 07:49:25.927243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: Jul 27 07:49:25.929180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:26.102484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11a3e219b4b43b9b56b9a7c3207b895'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.149459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:26.171446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11a3e219b4b43b9b56b9a7c3207b895'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.173652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11a3e219b4b43b9b56b9a7c3207b895'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.187039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11a3e219b4b43b9b56b9a7c3207b895'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.188347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11a3e219b4b43b9b56b9a7c3207b895'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.230605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aa7d5-cd4f-4632-a809-a5014f952e9b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:26.231451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aa7d5-cd4f-4632-a809-a5014f952e9b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:26.231451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aa7d5-cd4f-4632-a809-a5014f952e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:26.235775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 809/1634] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:25 2022] DELETE /identity/v3/users/c11a3e219b4b43b9b56b9a7c3207b895 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:26.252937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:26.256108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:26.265611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-265aa7d5-cd4f-4632-a809-a5014f952e9b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:26.267086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-265aa7d5-cd4f-4632-a809-a5014f952e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:26.280889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:26.372309 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85953c9d-c5b6-45e3-851c-1b17ed5276f3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:26.377912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:26.379212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:26.379711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:26.380358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] PATH_INFO: `/v3/users/3360b5960eaa4f14a6fbb8f10b74e85e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:26.382355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3360b5960eaa4f14a6fbb8f10b74e85e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:26.384976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:26.395506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 826/1635] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:26.406002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265aa7d5-cd4f-4632-a809-a5014f952e9b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:26.408283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-265aa7d5-cd4f-4632-a809-a5014f952e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:26.509449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3360b5960eaa4f14a6fbb8f10b74e85e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.532137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3360b5960eaa4f14a6fbb8f10b74e85e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.543653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3360b5960eaa4f14a6fbb8f10b74e85e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.555576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3360b5960eaa4f14a6fbb8f10b74e85e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.556217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-88479a43-b603-46e6-9041-cc2c24113fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3360b5960eaa4f14a6fbb8f10b74e85e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:26.579188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265aa7d5-cd4f-4632-a809-a5014f952e9b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:26.580730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 810/1636] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:26 2022] DELETE /identity/v3/users/3360b5960eaa4f14a6fbb8f10b74e85e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:26.585490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2830-aed8-43cd-a02d-50b2ff1d926c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:26.586351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2830-aed8-43cd-a02d-50b2ff1d926c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:26.586554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2830-aed8-43cd-a02d-50b2ff1d926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:26.633252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8d7b2830-aed8-43cd-a02d-50b2ff1d926c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:26.634506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8d7b2830-aed8-43cd-a02d-50b2ff1d926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:26.688733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595951-9f69-4714-87ce-c756ce494ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:26.689845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595951-9f69-4714-87ce-c756ce494ebd service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:26.690129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595951-9f69-4714-87ce-c756ce494ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:26.691800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595951-9f69-4714-87ce-c756ce494ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:26.700181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-74595951-9f69-4714-87ce-c756ce494ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:26.835846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:26.875717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 811/1637] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:49:26.955760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595951-9f69-4714-87ce-c756ce494ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:26.957667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595951-9f69-4714-87ce-c756ce494ebd service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:26.970696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 827/1638] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:49:27.058723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b2830-aed8-43cd-a02d-50b2ff1d926c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:27.060706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8d7b2830-aed8-43cd-a02d-50b2ff1d926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:27.095602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b2830-aed8-43cd-a02d-50b2ff1d926c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:27.111602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a9079-90f1-417f-8d0a-fc98122d48d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:27.112441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9079-90f1-417f-8d0a-fc98122d48d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:27.112728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9079-90f1-417f-8d0a-fc98122d48d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:27.114117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9079-90f1-417f-8d0a-fc98122d48d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:27.147963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a9079-90f1-417f-8d0a-fc98122d48d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:27.150665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a9079-90f1-417f-8d0a-fc98122d48d7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:27.178160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 812/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:27.771668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c375e-a7e2-4764-9828-53f219bbbe1c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:27.772227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c375e-a7e2-4764-9828-53f219bbbe1c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:27.772705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c375e-a7e2-4764-9828-53f219bbbe1c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:27.775090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 828/1640] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jul 27 07:49:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:49:27.782877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e66bb-f916-4e6d-bc8d-3220ddcc10a3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:27.783457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e66bb-f916-4e6d-bc8d-3220ddcc10a3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:27.784171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e66bb-f916-4e6d-bc8d-3220ddcc10a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:27.944444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-271e66bb-f916-4e6d-bc8d-3220ddcc10a3 None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:27.945826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-271e66bb-f916-4e6d-bc8d-3220ddcc10a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:28.123942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 813/1641] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jul 27 07:49:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:28.129433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db50c53-6568-47f4-8e87-3db95f6a37d3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:28.129866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db50c53-6568-47f4-8e87-3db95f6a37d3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:28.130243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db50c53-6568-47f4-8e87-3db95f6a37d3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:28.132046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 829/1642] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jul 27 07:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:49:28.139627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e2ffd-7eef-4ff3-8737-91760f9a8084 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:28.139916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e2ffd-7eef-4ff3-8737-91760f9a8084 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:28.140243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e2ffd-7eef-4ff3-8737-91760f9a8084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:28.176310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9c9e2ffd-7eef-4ff3-8737-91760f9a8084 None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:28.178282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9c9e2ffd-7eef-4ff3-8737-91760f9a8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:28.199794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 814/1643] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:49:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:28.214631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db50c53-6568-47f4-8e87-3db95f6a37d3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:28.214631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5db50c53-6568-47f4-8e87-3db95f6a37d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:28.287392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:28.366914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db50c53-6568-47f4-8e87-3db95f6a37d3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:28.372274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46e011-9712-48cf-bdd0-d08f902139d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:28.373460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46e011-9712-48cf-bdd0-d08f902139d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:28.373955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46e011-9712-48cf-bdd0-d08f902139d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:28.374471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46e011-9712-48cf-bdd0-d08f902139d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:28.398755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e2ffd-7eef-4ff3-8737-91760f9a8084 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:28.401324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9c9e2ffd-7eef-4ff3-8737-91760f9a8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:28.401919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46e011-9712-48cf-bdd0-d08f902139d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:28.403640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46e011-9712-48cf-bdd0-d08f902139d4 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:28.428608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e2ffd-7eef-4ff3-8737-91760f9a8084 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:28.432323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 830/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:28.435104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:28.435785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:28.436069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:28.436341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] PATH_INFO: `/v3/projects/6af1561d33e144caa9188e64b9d3d214` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:28.437733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af1561d33e144caa9188e64b9d3d214)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:28.442239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:28.559039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af1561d33e144caa9188e64b9d3d214', 'request_id': 'req-e085cb43-b81d-4f1d-8daf-60382f4abb4e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.575338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af1561d33e144caa9188e64b9d3d214', 'request_id': 'req-e085cb43-b81d-4f1d-8daf-60382f4abb4e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.587687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af1561d33e144caa9188e64b9d3d214', 'request_id': 'req-e085cb43-b81d-4f1d-8daf-60382f4abb4e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.619024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] The token cache is being invalidate because project 6af1561d33e144caa9188e64b9d3d214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:28.620162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.638349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.641818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 815/1645] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:28 2022] DELETE /identity/v3/projects/6af1561d33e144caa9188e64b9d3d214 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:49:28.645813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46e011-9712-48cf-bdd0-d08f902139d4 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:28.664801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46e011-9712-48cf-bdd0-d08f902139d4 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:28.803761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:28.803761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:28.803761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:28.803761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] PATH_INFO: `/v3/users/f5556dc3e9c54a1faec1cc91d4a4f5c9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:28.804578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5556dc3e9c54a1faec1cc91d4a4f5c9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:28.804578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:28.903176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5556dc3e9c54a1faec1cc91d4a4f5c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.917167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5556dc3e9c54a1faec1cc91d4a4f5c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.942413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5556dc3e9c54a1faec1cc91d4a4f5c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.944197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5556dc3e9c54a1faec1cc91d4a4f5c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.961689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5556dc3e9c54a1faec1cc91d4a4f5c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:28.979312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 831/1646] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:28 2022] DELETE /identity/v3/users/f5556dc3e9c54a1faec1cc91d4a4f5c9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:29.447225 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:29.448950 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:29.477843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085cb43-b81d-4f1d-8daf-60382f4abb4e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:29.556812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:29.612952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:29.614725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:29.615434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:29.615724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] PATH_INFO: `/v3/projects/601417033ad54e309a08ecd1bb50e83c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:29.617042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=601417033ad54e309a08ecd1bb50e83c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:29.619112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:29.756662 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601417033ad54e309a08ecd1bb50e83c', 'request_id': 'req-3442c552-6a9b-4374-9342-939e0f7429c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:29.768737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601417033ad54e309a08ecd1bb50e83c', 'request_id': 'req-3442c552-6a9b-4374-9342-939e0f7429c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:29.778501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601417033ad54e309a08ecd1bb50e83c', 'request_id': 'req-3442c552-6a9b-4374-9342-939e0f7429c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:29.839287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] The token cache is being invalidate because project 601417033ad54e309a08ecd1bb50e83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:29.841696 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:29.843461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3442c552-6a9b-4374-9342-939e0f7429c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:29.849191 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 816/1647] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:29 2022] DELETE /identity/v3/projects/601417033ad54e309a08ecd1bb50e83c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:29.853744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:29.855407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:29.884120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f367f-7cc1-44b3-9b60-04509232f480 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:30.021814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:30.059147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:30.059808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:30.060224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:30.060624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] PATH_INFO: `/v3/users/c565ab184b43405bb3652acb4d1e610e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:30.065999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c565ab184b43405bb3652acb4d1e610e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:30.068870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:30.172074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c565ab184b43405bb3652acb4d1e610e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:30.193833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c565ab184b43405bb3652acb4d1e610e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:30.225162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c565ab184b43405bb3652acb4d1e610e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:30.235328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c565ab184b43405bb3652acb4d1e610e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:30.272392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce460094-6d6a-4355-a6d4-ad0f15a8109d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c565ab184b43405bb3652acb4d1e610e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:30.281046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 832/1648] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:29 2022] DELETE /identity/v3/users/c565ab184b43405bb3652acb4d1e610e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:30.797290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d612d7-7aef-47ea-a7b0-d655bcaea41a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:30.798599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d612d7-7aef-47ea-a7b0-d655bcaea41a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:30.800385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d612d7-7aef-47ea-a7b0-d655bcaea41a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:30.806913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 817/1649] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jul 27 07:49:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:49:30.828192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ea687-d70c-4014-b2d9-49b8bf831c09 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:30.828714 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ea687-d70c-4014-b2d9-49b8bf831c09 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:30.829070 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ea687-d70c-4014-b2d9-49b8bf831c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:30.866414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-190ea687-d70c-4014-b2d9-49b8bf831c09 None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:30.868085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-190ea687-d70c-4014-b2d9-49b8bf831c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:30.986290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5a36-2c69-489c-a74d-4220bb50b61c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:30.986991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5a36-2c69-489c-a74d-4220bb50b61c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:30.987471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e5a36-2c69-489c-a74d-4220bb50b61c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:30.989075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 818/1650] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jul 27 07:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:49:30.994763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe338-0139-4f55-87cb-762887cbe14b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:30.995384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe338-0139-4f55-87cb-762887cbe14b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:30.995860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe338-0139-4f55-87cb-762887cbe14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:30.999741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 833/1651] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jul 27 07:49:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:31.019993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-121fe338-0139-4f55-87cb-762887cbe14b None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:31.021690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-121fe338-0139-4f55-87cb-762887cbe14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:31.044009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 819/1652] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:49:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:49:31.052169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ea687-d70c-4014-b2d9-49b8bf831c09 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:31.054081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-190ea687-d70c-4014-b2d9-49b8bf831c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:31.143097 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ea687-d70c-4014-b2d9-49b8bf831c09 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:31.149599 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a9717-6230-4a1d-b036-588119698455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:31.151862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9717-6230-4a1d-b036-588119698455 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:31.152440 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9717-6230-4a1d-b036-588119698455 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:31.152905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9717-6230-4a1d-b036-588119698455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:31.178409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a9717-6230-4a1d-b036-588119698455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:31.182100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a9717-6230-4a1d-b036-588119698455 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:31.210268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:31.230691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 834/1653] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:31.238266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fe338-0139-4f55-87cb-762887cbe14b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:31.240625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-121fe338-0139-4f55-87cb-762887cbe14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:31.424207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fe338-0139-4f55-87cb-762887cbe14b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:31.445008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:31.445698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:31.448809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:31.450705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] PATH_INFO: `/v3/projects/9ff53dcba5ba4d638f6bcb1579eb845a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:31.455807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff53dcba5ba4d638f6bcb1579eb845a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:31.461231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:31.635377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff53dcba5ba4d638f6bcb1579eb845a', 'request_id': 'req-03f1ff16-5e93-4472-910f-a4eb3c5ac544'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:31.660855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff53dcba5ba4d638f6bcb1579eb845a', 'request_id': 'req-03f1ff16-5e93-4472-910f-a4eb3c5ac544'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:31.669177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:31.670684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff53dcba5ba4d638f6bcb1579eb845a', 'request_id': 'req-03f1ff16-5e93-4472-910f-a4eb3c5ac544'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:31.694301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] The token cache is being invalidate because project 9ff53dcba5ba4d638f6bcb1579eb845a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:31.694637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:31.695430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03f1ff16-5e93-4472-910f-a4eb3c5ac544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:31.700352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 820/1654] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:31 2022] DELETE /identity/v3/projects/9ff53dcba5ba4d638f6bcb1579eb845a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:31.702689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ede9-0d71-43be-8ba1-e348a1a48654 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:31.703198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ede9-0d71-43be-8ba1-e348a1a48654 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:31.703660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ede9-0d71-43be-8ba1-e348a1a48654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:31.744365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8d32ede9-0d71-43be-8ba1-e348a1a48654 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:31.746841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8d32ede9-0d71-43be-8ba1-e348a1a48654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:31.873340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 835/1655] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:31.882278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784770ad-1d83-4a72-b88e-0148d5878202 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:31.882821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784770ad-1d83-4a72-b88e-0148d5878202 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:31.882821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784770ad-1d83-4a72-b88e-0148d5878202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:31.911128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-784770ad-1d83-4a72-b88e-0148d5878202 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:31.912955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-784770ad-1d83-4a72-b88e-0148d5878202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:31.923564 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 821/1656] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:31.927744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ede9-0d71-43be-8ba1-e348a1a48654 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:31.938763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ede9-0d71-43be-8ba1-e348a1a48654 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:31.946343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c4da7-97a1-4f0a-99bb-4b5ed72d8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:31.947284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c4da7-97a1-4f0a-99bb-4b5ed72d8415 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:31.947562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c4da7-97a1-4f0a-99bb-4b5ed72d8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:31.947855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c4da7-97a1-4f0a-99bb-4b5ed72d8415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:31.948575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c4da7-97a1-4f0a-99bb-4b5ed72d8415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:31.948879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c4da7-97a1-4f0a-99bb-4b5ed72d8415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:31.950526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c4da7-97a1-4f0a-99bb-4b5ed72d8415 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:31.972234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 836/1657] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:31.977552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784770ad-1d83-4a72-b88e-0148d5878202 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:31.998950 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784770ad-1d83-4a72-b88e-0148d5878202 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:32.018426 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefc314-6ef5-4dde-b213-e891b0b85243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:32.019684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefc314-6ef5-4dde-b213-e891b0b85243 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:32.020865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefc314-6ef5-4dde-b213-e891b0b85243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:32.022242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefc314-6ef5-4dde-b213-e891b0b85243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:32.023346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefc314-6ef5-4dde-b213-e891b0b85243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:32.026049 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefc314-6ef5-4dde-b213-e891b0b85243 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:32.103307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 822/1658] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:31 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:49:32.107157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c4da7-97a1-4f0a-99bb-4b5ed72d8415 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:32.135243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c4da7-97a1-4f0a-99bb-4b5ed72d8415 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:32.250485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273bd53-a38f-4327-b7bf-3ff6694c9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:32.251196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273bd53-a38f-4327-b7bf-3ff6694c9b1c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:32.251478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273bd53-a38f-4327-b7bf-3ff6694c9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:32.251749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273bd53-a38f-4327-b7bf-3ff6694c9b1c admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:32.252441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273bd53-a38f-4327-b7bf-3ff6694c9b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:32.254419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273bd53-a38f-4327-b7bf-3ff6694c9b1c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:32.302814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 837/1659] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:32 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:49:32.307023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefc314-6ef5-4dde-b213-e891b0b85243 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:32.332382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefc314-6ef5-4dde-b213-e891b0b85243 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:32.352678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e281-64ec-4f5f-a76d-4d98f84f854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:32.353616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e281-64ec-4f5f-a76d-4d98f84f854c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:32.354149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e281-64ec-4f5f-a76d-4d98f84f854c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:32.354860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e281-64ec-4f5f-a76d-4d98f84f854c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:32.356005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5e281-64ec-4f5f-a76d-4d98f84f854c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:32.358578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5e281-64ec-4f5f-a76d-4d98f84f854c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:32.375762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 823/1660] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:32.379109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273bd53-a38f-4327-b7bf-3ff6694c9b1c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:32.392250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273bd53-a38f-4327-b7bf-3ff6694c9b1c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:32.398799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e70be-af13-4bc9-9289-1de7312132c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:32.399505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e70be-af13-4bc9-9289-1de7312132c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:32.399635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e70be-af13-4bc9-9289-1de7312132c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:32.399876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e70be-af13-4bc9-9289-1de7312132c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:32.400589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e70be-af13-4bc9-9289-1de7312132c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:32.402253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e70be-af13-4bc9-9289-1de7312132c5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:32.422035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e281-64ec-4f5f-a76d-4d98f84f854c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:32.431885 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 838/1661] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:32.444736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e281-64ec-4f5f-a76d-4d98f84f854c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:32.452001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29ec45-160c-4ce9-8226-d4417e2ed05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:32.465746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29ec45-160c-4ce9-8226-d4417e2ed05c admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:32.468452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29ec45-160c-4ce9-8226-d4417e2ed05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:32.468968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29ec45-160c-4ce9-8226-d4417e2ed05c admin admin] PATH_INFO: `/v3/projects/a71c1c7ada264133ad93f3b58190235a/users/7133c5d4ca4748b48a5e2520b8ebdd02/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:32.497601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29ec45-160c-4ce9-8226-d4417e2ed05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71c1c7ada264133ad93f3b58190235a, user_id=7133c5d4ca4748b48a5e2520b8ebdd02, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:32.500886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29ec45-160c-4ce9-8226-d4417e2ed05c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:32.556535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90feb4-56ba-4734-a9eb-a6947dfe13da None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:32.557067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90feb4-56ba-4734-a9eb-a6947dfe13da None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:32.557551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90feb4-56ba-4734-a9eb-a6947dfe13da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:32.560706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 824/1662] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:32 2022] PUT /identity/v3/projects/a71c1c7ada264133ad93f3b58190235a/users/7133c5d4ca4748b48a5e2520b8ebdd02/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:32.610660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bf90feb4-56ba-4734-a9eb-a6947dfe13da None None] MFA Rules not processed for user `7133c5d4ca4748b48a5e2520b8ebdd02`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:32.612667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bf90feb4-56ba-4734-a9eb-a6947dfe13da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:32.765438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:32.791865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29ec45-160c-4ce9-8226-d4417e2ed05c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:32.817307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 839/1663] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:49:32.868548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90feb4-56ba-4734-a9eb-a6947dfe13da None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:32.871245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bf90feb4-56ba-4734-a9eb-a6947dfe13da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:32.996287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29ec45-160c-4ce9-8226-d4417e2ed05c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:33.002866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231a4e0-a623-48ed-b3c4-64ffc4229b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:33.003892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231a4e0-a623-48ed-b3c4-64ffc4229b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.004384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231a4e0-a623-48ed-b3c4-64ffc4229b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.005010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231a4e0-a623-48ed-b3c4-64ffc4229b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.006440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231a4e0-a623-48ed-b3c4-64ffc4229b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:33.008886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231a4e0-a623-48ed-b3c4-64ffc4229b20 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:33.085317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 825/1664] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:32 2022] POST /identity/v3/projects => generated 363 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:33.086660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231a4e0-a623-48ed-b3c4-64ffc4229b20 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:33.159159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90feb4-56ba-4734-a9eb-a6947dfe13da None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:33.200499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231a4e0-a623-48ed-b3c4-64ffc4229b20 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:33.215439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c606ee-16a4-4bed-803b-38134999241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:33.216238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c606ee-16a4-4bed-803b-38134999241c admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.216791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c606ee-16a4-4bed-803b-38134999241c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.217165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c606ee-16a4-4bed-803b-38134999241c admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.219036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c606ee-16a4-4bed-803b-38134999241c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:33.226742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c606ee-16a4-4bed-803b-38134999241c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:33.303613 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 826/1665] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:33 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:33.305274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c606ee-16a4-4bed-803b-38134999241c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:33.327332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:33.340150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c606ee-16a4-4bed-803b-38134999241c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:33.346733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac836-626f-4dd1-b537-af5868005d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:33.348278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac836-626f-4dd1-b537-af5868005d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.348713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac836-626f-4dd1-b537-af5868005d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.349928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac836-626f-4dd1-b537-af5868005d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.350763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ac836-626f-4dd1-b537-af5868005d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:33.353073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ac836-626f-4dd1-b537-af5868005d7b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:33.375441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 827/1666] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:33.377495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac836-626f-4dd1-b537-af5868005d7b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:33.388318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:33.388993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.389434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.389543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] PATH_INFO: `/v3/projects/23b78652fdcf48658021c784af2f0a79` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.395426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b78652fdcf48658021c784af2f0a79)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:33.397052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:49:33.397052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jul 27 07:49:33.397052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: Jul 27 07:49:33.403723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:33.407687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac836-626f-4dd1-b537-af5868005d7b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:33.428830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a89425-6de3-40c2-a08c-785ebb13e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:33.429881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a89425-6de3-40c2-a08c-785ebb13e701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.433041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a89425-6de3-40c2-a08c-785ebb13e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.433705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a89425-6de3-40c2-a08c-785ebb13e701 admin admin] PATH_INFO: `/v3/projects/9053f0b7736448b39391f95e03fc9c35/users/9cada74734554961a265e5523c431d11/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.486695 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a89425-6de3-40c2-a08c-785ebb13e701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9053f0b7736448b39391f95e03fc9c35, user_id=9cada74734554961a265e5523c431d11, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:33.489210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a89425-6de3-40c2-a08c-785ebb13e701 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:33.520128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 828/1667] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:33 2022] PUT /identity/v3/projects/9053f0b7736448b39391f95e03fc9c35/users/9cada74734554961a265e5523c431d11/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:33.522099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a89425-6de3-40c2-a08c-785ebb13e701 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:33.566155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b78652fdcf48658021c784af2f0a79', 'request_id': 'req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:33.583915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b78652fdcf48658021c784af2f0a79', 'request_id': 'req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:33.608892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b78652fdcf48658021c784af2f0a79', 'request_id': 'req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:33.657284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] The token cache is being invalidate because project 23b78652fdcf48658021c784af2f0a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:33.657579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:33.661811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47b8d2f4-2dde-4c26-9d6e-b41f0f6c819f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:33.667252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 840/1668] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:32 2022] DELETE /identity/v3/projects/23b78652fdcf48658021c784af2f0a79 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:33.672071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de967e4-d8d9-4769-8266-d57ca102d5f8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.672354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de967e4-d8d9-4769-8266-d57ca102d5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.672629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de967e4-d8d9-4769-8266-d57ca102d5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.680149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a89425-6de3-40c2-a08c-785ebb13e701 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:33.693990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ebec1-cec7-4336-bc23-d8b8e8422901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:33.694968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ebec1-cec7-4336-bc23-d8b8e8422901 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.695254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ebec1-cec7-4336-bc23-d8b8e8422901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.695523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ebec1-cec7-4336-bc23-d8b8e8422901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.696253 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ebec1-cec7-4336-bc23-d8b8e8422901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:33.701367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ebec1-cec7-4336-bc23-d8b8e8422901 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:33.714352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8de967e4-d8d9-4769-8266-d57ca102d5f8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:33.717477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8de967e4-d8d9-4769-8266-d57ca102d5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:33.723136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 829/1669] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:33.728706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ebec1-cec7-4336-bc23-d8b8e8422901 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:33.732148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0b3ebec1-cec7-4336-bc23-d8b8e8422901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:33.739965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 841/1670] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:49:33.748766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da029f9-9047-4c9e-bb8d-4d99d5996a33 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.749046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da029f9-9047-4c9e-bb8d-4d99d5996a33 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.749324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da029f9-9047-4c9e-bb8d-4d99d5996a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.755164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ebec1-cec7-4336-bc23-d8b8e8422901 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:33.773308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49e692-7587-40ef-90fb-015e61728199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:33.775486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49e692-7587-40ef-90fb-015e61728199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.775619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49e692-7587-40ef-90fb-015e61728199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.775838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49e692-7587-40ef-90fb-015e61728199 admin admin] PATH_INFO: `/v3/projects/9053f0b7736448b39391f95e03fc9c35/users/9cada74734554961a265e5523c431d11/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.781933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49e692-7587-40ef-90fb-015e61728199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9053f0b7736448b39391f95e03fc9c35, user_id=9cada74734554961a265e5523c431d11, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:33.788549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49e692-7587-40ef-90fb-015e61728199 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:33.790135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4da029f9-9047-4c9e-bb8d-4d99d5996a33 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:33.791437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4da029f9-9047-4c9e-bb8d-4d99d5996a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:33.811195 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 842/1671] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:33.811453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 830/1672] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:33 2022] PUT /identity/v3/projects/9053f0b7736448b39391f95e03fc9c35/users/9cada74734554961a265e5523c431d11/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:33.822395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da029f9-9047-4c9e-bb8d-4d99d5996a33 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:33.827946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a15d-eda9-4074-bc4b-43a86425906e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:33.828229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a15d-eda9-4074-bc4b-43a86425906e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:33.828498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a15d-eda9-4074-bc4b-43a86425906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:33.871895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da029f9-9047-4c9e-bb8d-4d99d5996a33 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:33.888737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2618a15d-eda9-4074-bc4b-43a86425906e None None] MFA Rules not processed for user `9cada74734554961a265e5523c431d11`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:33.890248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2618a15d-eda9-4074-bc4b-43a86425906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:33.916213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:34.024964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a168f-8211-431d-b3c7-8c2854dff702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:34.025608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a168f-8211-431d-b3c7-8c2854dff702 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:34.025891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a168f-8211-431d-b3c7-8c2854dff702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:34.026207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a168f-8211-431d-b3c7-8c2854dff702 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:34.027876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a168f-8211-431d-b3c7-8c2854dff702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:34.028227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a168f-8211-431d-b3c7-8c2854dff702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:34.036041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a168f-8211-431d-b3c7-8c2854dff702 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:34.064750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 843/1673] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:34.066977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00afe4-0bd5-44a3-ab5c-35a90fbf1e28 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:34.067431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00afe4-0bd5-44a3-ab5c-35a90fbf1e28 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:34.070180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00afe4-0bd5-44a3-ab5c-35a90fbf1e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:34.083016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 831/1674] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:34.096681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618a15d-eda9-4074-bc4b-43a86425906e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:34.120868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618a15d-eda9-4074-bc4b-43a86425906e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:34.145800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbaca37-40cf-4789-bbdb-2c61a414ed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:34.147044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaca37-40cf-4789-bbdb-2c61a414ed54 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:34.147434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaca37-40cf-4789-bbdb-2c61a414ed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:34.147771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaca37-40cf-4789-bbdb-2c61a414ed54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:34.148469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbaca37-40cf-4789-bbdb-2c61a414ed54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:34.150562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbaca37-40cf-4789-bbdb-2c61a414ed54 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:34.157957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fd00afe4-0bd5-44a3-ab5c-35a90fbf1e28 None None] MFA Rules not processed for user `7e3a5b392d9d44859110f048bea7331b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:34.162428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fd00afe4-0bd5-44a3-ab5c-35a90fbf1e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:34.218243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 832/1675] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:34 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:34.223492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbaca37-40cf-4789-bbdb-2c61a414ed54 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:34.227435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7fbaca37-40cf-4789-bbdb-2c61a414ed54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:34.276354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:34.363452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 844/1676] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:34.372341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00afe4-0bd5-44a3-ab5c-35a90fbf1e28 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:34.398621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbaca37-40cf-4789-bbdb-2c61a414ed54 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:34.409100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e5a1e-35bc-41fc-9cb6-91c1d2fd1e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:34.410063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5a1e-35bc-41fc-9cb6-91c1d2fd1e94 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:34.410562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5a1e-35bc-41fc-9cb6-91c1d2fd1e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:34.410663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00afe4-0bd5-44a3-ab5c-35a90fbf1e28 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:34.417788 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5a1e-35bc-41fc-9cb6-91c1d2fd1e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:34.560962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189efd6-15e3-4b90-9559-734cd547d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:34.563427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189efd6-15e3-4b90-9559-734cd547d473 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:34.563804 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189efd6-15e3-4b90-9559-734cd547d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:34.564485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189efd6-15e3-4b90-9559-734cd547d473 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:34.566226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189efd6-15e3-4b90-9559-734cd547d473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:34.569165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e5a1e-35bc-41fc-9cb6-91c1d2fd1e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:34.571832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e5a1e-35bc-41fc-9cb6-91c1d2fd1e94 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:34.572452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189efd6-15e3-4b90-9559-734cd547d473 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:34.608760 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 833/1677] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:34 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:34.609919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e5a1e-35bc-41fc-9cb6-91c1d2fd1e94 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:34.611953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-204e5a1e-35bc-41fc-9cb6-91c1d2fd1e94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:34.624874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 845/1678] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:34 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:34.633129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189efd6-15e3-4b90-9559-734cd547d473 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:34.659467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189efd6-15e3-4b90-9559-734cd547d473 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:34.677765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0192371-9eec-41a7-8109-ecbd35ceda84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:34.679593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0192371-9eec-41a7-8109-ecbd35ceda84 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:34.681008 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0192371-9eec-41a7-8109-ecbd35ceda84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:34.681296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0192371-9eec-41a7-8109-ecbd35ceda84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:34.683891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0192371-9eec-41a7-8109-ecbd35ceda84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:34.686858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0192371-9eec-41a7-8109-ecbd35ceda84 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:34.747311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 846/1679] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:34.752362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0192371-9eec-41a7-8109-ecbd35ceda84 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:34.777373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0192371-9eec-41a7-8109-ecbd35ceda84 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:34.798654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de75fe-1b71-4b4c-afc9-ba894190839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:34.799584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de75fe-1b71-4b4c-afc9-ba894190839b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:34.800824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de75fe-1b71-4b4c-afc9-ba894190839b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:34.800824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de75fe-1b71-4b4c-afc9-ba894190839b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:34.808750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de75fe-1b71-4b4c-afc9-ba894190839b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:34.811649 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de75fe-1b71-4b4c-afc9-ba894190839b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:34.856101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 847/1680] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:34.866981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de75fe-1b71-4b4c-afc9-ba894190839b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:34.896796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e5a1e-35bc-41fc-9cb6-91c1d2fd1e94 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:34.899668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de75fe-1b71-4b4c-afc9-ba894190839b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:34.910313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7279f61-bbd9-4ab3-878e-871053a49ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:34.911043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7279f61-bbd9-4ab3-878e-871053a49ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:34.912618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e44d24-61a4-4cef-b7a9-9037124157be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:34.913252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e44d24-61a4-4cef-b7a9-9037124157be service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:34.913526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e44d24-61a4-4cef-b7a9-9037124157be service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:34.913793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e44d24-61a4-4cef-b7a9-9037124157be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:34.914447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7279f61-bbd9-4ab3-878e-871053a49ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:34.914915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7279f61-bbd9-4ab3-878e-871053a49ca7 admin admin] PATH_INFO: `/v3/projects/6983306995a64ff4960728195979eac4/users/91422a184dd94321ac6a4e7278c4a99f/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:34.944917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:34.983340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7279f61-bbd9-4ab3-878e-871053a49ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6983306995a64ff4960728195979eac4, user_id=91422a184dd94321ac6a4e7278c4a99f, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:35.008326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7279f61-bbd9-4ab3-878e-871053a49ca7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:35.057120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 848/1681] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:34 2022] PUT /identity/v3/projects/6983306995a64ff4960728195979eac4/users/91422a184dd94321ac6a4e7278c4a99f/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:35.068838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbcaf8-66d0-4c43-b61f-b0d81d26b53a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:35.070116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbcaf8-66d0-4c43-b61f-b0d81d26b53a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:35.070116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbcaf8-66d0-4c43-b61f-b0d81d26b53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:35.179608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e44d24-61a4-4cef-b7a9-9037124157be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:35.184812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-36fbcaf8-66d0-4c43-b61f-b0d81d26b53a None None] MFA Rules not processed for user `91422a184dd94321ac6a4e7278c4a99f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:35.188756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e44d24-61a4-4cef-b7a9-9037124157be service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:35.190346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-36fbcaf8-66d0-4c43-b61f-b0d81d26b53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:35.207097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:35.225528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 834/1682] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:35.398367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 849/1683] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:35.403488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e44d24-61a4-4cef-b7a9-9037124157be service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:35.440945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e44d24-61a4-4cef-b7a9-9037124157be service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:35.696623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9a77-b1b2-426b-a9cb-97b9ee9bfac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:35.697838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9a77-b1b2-426b-a9cb-97b9ee9bfac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:35.698126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9a77-b1b2-426b-a9cb-97b9ee9bfac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:35.698404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9a77-b1b2-426b-a9cb-97b9ee9bfac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:35.699153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9a77-b1b2-426b-a9cb-97b9ee9bfac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:35.706379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9a77-b1b2-426b-a9cb-97b9ee9bfac2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:35.780376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 835/1684] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:35 2022] POST /identity/v3/projects => generated 367 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:35.784562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbcaf8-66d0-4c43-b61f-b0d81d26b53a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:35.819359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbcaf8-66d0-4c43-b61f-b0d81d26b53a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:35.898731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9a77-b1b2-426b-a9cb-97b9ee9bfac2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:36.013404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9a77-b1b2-426b-a9cb-97b9ee9bfac2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:36.019191 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:36.019962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:36.020324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:36.020670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] PATH_INFO: `/v3/users/7133c5d4ca4748b48a5e2520b8ebdd02` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:36.023665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7133c5d4ca4748b48a5e2520b8ebdd02)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:36.029750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:36.037799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c00f4-83fd-450a-af41-33e2ae823458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:36.043502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c00f4-83fd-450a-af41-33e2ae823458 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:36.043934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c00f4-83fd-450a-af41-33e2ae823458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:36.045305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c00f4-83fd-450a-af41-33e2ae823458 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:36.049924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c00f4-83fd-450a-af41-33e2ae823458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:36.057074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c00f4-83fd-450a-af41-33e2ae823458 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:36.121810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 850/1685] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:35 2022] POST /identity/v3/users => generated 290 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:36.126349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c00f4-83fd-450a-af41-33e2ae823458 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:36.136636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7133c5d4ca4748b48a5e2520b8ebdd02'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:36.149643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c00f4-83fd-450a-af41-33e2ae823458 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:36.158448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe12ae-c383-4521-9e88-5aa26af428c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:36.159150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe12ae-c383-4521-9e88-5aa26af428c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:36.159500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe12ae-c383-4521-9e88-5aa26af428c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:36.159893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe12ae-c383-4521-9e88-5aa26af428c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:36.161203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe12ae-c383-4521-9e88-5aa26af428c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:36.164652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe12ae-c383-4521-9e88-5aa26af428c1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:36.174147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7133c5d4ca4748b48a5e2520b8ebdd02'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:36.175271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7133c5d4ca4748b48a5e2520b8ebdd02'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:36.182163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 851/1686] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:49:36.186137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe12ae-c383-4521-9e88-5aa26af428c1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:36.201558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7133c5d4ca4748b48a5e2520b8ebdd02'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:36.202292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-58f7227d-08ca-4375-9617-eff12ef42ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7133c5d4ca4748b48a5e2520b8ebdd02'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:36.208342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe12ae-c383-4521-9e88-5aa26af428c1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:36.232479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58e08-ba26-405b-8342-a9712406aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:36.233744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58e08-ba26-405b-8342-a9712406aa2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:36.234038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58e08-ba26-405b-8342-a9712406aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:36.234549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 836/1687] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:35 2022] DELETE /identity/v3/users/7133c5d4ca4748b48a5e2520b8ebdd02 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:36.234665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58e08-ba26-405b-8342-a9712406aa2e admin admin] PATH_INFO: `/v3/projects/e3a4d89c612e48df81828affc081a157/users/6edd1fd800294fcaa66dd2d9733d27be/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:36.237841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d32478-2d84-4f0e-9b2a-cbdb717cfae1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:36.237841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d32478-2d84-4f0e-9b2a-cbdb717cfae1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:36.240211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d32478-2d84-4f0e-9b2a-cbdb717cfae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:36.258554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:36.270203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58e08-ba26-405b-8342-a9712406aa2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a4d89c612e48df81828affc081a157, user_id=6edd1fd800294fcaa66dd2d9733d27be, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:36.277642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58e08-ba26-405b-8342-a9712406aa2e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:36.286204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b9d32478-2d84-4f0e-9b2a-cbdb717cfae1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:36.289446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b9d32478-2d84-4f0e-9b2a-cbdb717cfae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:36.311380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 852/1688] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:36 2022] PUT /identity/v3/projects/e3a4d89c612e48df81828affc081a157/users/6edd1fd800294fcaa66dd2d9733d27be/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:49:36.319009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58e08-ba26-405b-8342-a9712406aa2e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:36.328820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-25c58e08-ba26-405b-8342-a9712406aa2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:36.450856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:36.501994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 837/1689] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:36.517745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58e08-ba26-405b-8342-a9712406aa2e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:36.524356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d32478-2d84-4f0e-9b2a-cbdb717cfae1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:36.529007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b9d32478-2d84-4f0e-9b2a-cbdb717cfae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:36.531803 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a2850-6413-408f-a92f-253a4fd1b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:36.532132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a2850-6413-408f-a92f-253a4fd1b021 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:36.532411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a2850-6413-408f-a92f-253a4fd1b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:36.532681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a2850-6413-408f-a92f-253a4fd1b021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:36.533392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a2850-6413-408f-a92f-253a4fd1b021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:36.535179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a2850-6413-408f-a92f-253a4fd1b021 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:36.579715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 853/1690] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:36.580330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a2850-6413-408f-a92f-253a4fd1b021 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:36.610864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a2850-6413-408f-a92f-253a4fd1b021 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:36.618799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a61eb-f138-4820-8e70-f81a827d7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:36.619570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a61eb-f138-4820-8e70-f81a827d7b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:36.619820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a61eb-f138-4820-8e70-f81a827d7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:36.620378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a61eb-f138-4820-8e70-f81a827d7b6c admin admin] PATH_INFO: `/v3/projects/e3a4d89c612e48df81828affc081a157/users/6edd1fd800294fcaa66dd2d9733d27be/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:36.623688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a61eb-f138-4820-8e70-f81a827d7b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a4d89c612e48df81828affc081a157, user_id=6edd1fd800294fcaa66dd2d9733d27be, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:36.628981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a61eb-f138-4820-8e70-f81a827d7b6c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:36.656274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 854/1691] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:36 2022] PUT /identity/v3/projects/e3a4d89c612e48df81828affc081a157/users/6edd1fd800294fcaa66dd2d9733d27be/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:36.662411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d32478-2d84-4f0e-9b2a-cbdb717cfae1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:36.667495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4019b3e-7971-4eb2-9761-011057e23f6f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:36.667681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4019b3e-7971-4eb2-9761-011057e23f6f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:36.667909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4019b3e-7971-4eb2-9761-011057e23f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:36.741964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a4019b3e-7971-4eb2-9761-011057e23f6f None None] MFA Rules not processed for user `6edd1fd800294fcaa66dd2d9733d27be`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:36.743654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a4019b3e-7971-4eb2-9761-011057e23f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:36.787736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217797b-3ab0-4c4e-8c13-e28dfdce970d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:36.790620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217797b-3ab0-4c4e-8c13-e28dfdce970d service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:36.791202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217797b-3ab0-4c4e-8c13-e28dfdce970d service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:36.792321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217797b-3ab0-4c4e-8c13-e28dfdce970d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:36.911083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 855/1692] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:36 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:36.922597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4019b3e-7971-4eb2-9761-011057e23f6f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:36.924210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a4019b3e-7971-4eb2-9761-011057e23f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:36.986778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217797b-3ab0-4c4e-8c13-e28dfdce970d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:36.988684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217797b-3ab0-4c4e-8c13-e28dfdce970d service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:37.002743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 838/1693] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:37.061872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4019b3e-7971-4eb2-9761-011057e23f6f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:37.073706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78895-ea48-4f7c-8a83-7ce4c78d6b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:37.074357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78895-ea48-4f7c-8a83-7ce4c78d6b9f service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:37.074634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78895-ea48-4f7c-8a83-7ce4c78d6b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:37.074988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78895-ea48-4f7c-8a83-7ce4c78d6b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:37.108135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a78895-ea48-4f7c-8a83-7ce4c78d6b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:37.110047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a78895-ea48-4f7c-8a83-7ce4c78d6b9f service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:37.171262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 856/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:49:37.544777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217797b-3ab0-4c4e-8c13-e28dfdce970d service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:37.561802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217797b-3ab0-4c4e-8c13-e28dfdce970d service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:37.573915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522ebe3-e881-4570-892f-e2af37c04d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:37.574809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ebe3-e881-4570-892f-e2af37c04d5b service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:37.576190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ebe3-e881-4570-892f-e2af37c04d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:37.576839 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ebe3-e881-4570-892f-e2af37c04d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:37.581714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1522ebe3-e881-4570-892f-e2af37c04d5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:37.604512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:37.737648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522ebe3-e881-4570-892f-e2af37c04d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:37.739112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522ebe3-e881-4570-892f-e2af37c04d5b service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:37.762051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 839/1695] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:38.024788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78895-ea48-4f7c-8a83-7ce4c78d6b9f service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:38.026814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b8a78895-ea48-4f7c-8a83-7ce4c78d6b9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:38.057026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78895-ea48-4f7c-8a83-7ce4c78d6b9f service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:38.072104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:38.075869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:38.076299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:38.076720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] PATH_INFO: `/v3/projects/a71c1c7ada264133ad93f3b58190235a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:38.080141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71c1c7ada264133ad93f3b58190235a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:38.087843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:38.181859 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:38.200752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71c1c7ada264133ad93f3b58190235a', 'request_id': 'req-9c151b93-e342-4b92-8218-9bdf5966ab32'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.213841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71c1c7ada264133ad93f3b58190235a', 'request_id': 'req-9c151b93-e342-4b92-8218-9bdf5966ab32'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.221202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71c1c7ada264133ad93f3b58190235a', 'request_id': 'req-9c151b93-e342-4b92-8218-9bdf5966ab32'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.248605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] The token cache is being invalidate because project a71c1c7ada264133ad93f3b58190235a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:38.248916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.249771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.256653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 857/1696] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:38 2022] DELETE /identity/v3/projects/a71c1c7ada264133ad93f3b58190235a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:38.258061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522ebe3-e881-4570-892f-e2af37c04d5b service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:38.276195 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522ebe3-e881-4570-892f-e2af37c04d5b service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:38.460500 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:38.461239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:38.461520 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:38.461793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] PATH_INFO: `/v3/users/9cada74734554961a265e5523c431d11` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:38.463644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cada74734554961a265e5523c431d11)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:38.466144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:38.657650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cada74734554961a265e5523c431d11'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.702304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cada74734554961a265e5523c431d11'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.703096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cada74734554961a265e5523c431d11'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.717516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cada74734554961a265e5523c431d11'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.718287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cada74734554961a265e5523c431d11'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:38.772818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 840/1697] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:38 2022] DELETE /identity/v3/users/9cada74734554961a265e5523c431d11 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:39.939535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:39.941054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:39.978057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c151b93-e342-4b92-8218-9bdf5966ab32 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:40.153277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:40.154189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:40.154562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:40.154969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] PATH_INFO: `/v3/users/7d1d9ff09ca94ef880c30452b1f247ff` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:40.158743 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1d9ff09ca94ef880c30452b1f247ff)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:40.165065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:40.277621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:40.279338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:40.288058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1d9ff09ca94ef880c30452b1f247ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.300756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1d9ff09ca94ef880c30452b1f247ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.322623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ed3c0-e4f8-4659-88af-c000a9ffdb10 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:40.323921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1d9ff09ca94ef880c30452b1f247ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.324923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1d9ff09ca94ef880c30452b1f247ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.336823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:40.337785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:40.338201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:40.338616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] PATH_INFO: `/v3/projects/9053f0b7736448b39391f95e03fc9c35` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:40.340191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2cc32c65-a421-4c71-9c62-30b8f1a7526f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1d9ff09ca94ef880c30452b1f247ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.341001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9053f0b7736448b39391f95e03fc9c35)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:40.346982 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:40.361208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 858/1698] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:39 2022] DELETE /identity/v3/users/7d1d9ff09ca94ef880c30452b1f247ff => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:40.366378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e07ee-25ca-4114-8adc-5d608f10faf7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:40.366869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e07ee-25ca-4114-8adc-5d608f10faf7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:40.367485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e07ee-25ca-4114-8adc-5d608f10faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:40.400538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5f6e07ee-25ca-4114-8adc-5d608f10faf7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:40.403039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5f6e07ee-25ca-4114-8adc-5d608f10faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:40.449914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:40.490504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9053f0b7736448b39391f95e03fc9c35', 'request_id': 'req-5edf8d0d-da81-4f70-873b-4533896a30af'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.509314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:40.513571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9053f0b7736448b39391f95e03fc9c35', 'request_id': 'req-5edf8d0d-da81-4f70-873b-4533896a30af'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.542712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9053f0b7736448b39391f95e03fc9c35', 'request_id': 'req-5edf8d0d-da81-4f70-873b-4533896a30af'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.556787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] The token cache is being invalidate because project 9053f0b7736448b39391f95e03fc9c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:40.557094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.557758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5edf8d0d-da81-4f70-873b-4533896a30af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:40.559811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 859/1699] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:40.561307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13dcf-15c5-4f14-a209-2f276a6ca174 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:40.567389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 841/1700] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:40 2022] DELETE /identity/v3/projects/9053f0b7736448b39391f95e03fc9c35 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:40.568789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13dcf-15c5-4f14-a209-2f276a6ca174 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:40.568789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13dcf-15c5-4f14-a209-2f276a6ca174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:40.570696 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357dfe8-43e7-4731-9148-49e73397db5b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:40.571037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357dfe8-43e7-4731-9148-49e73397db5b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:40.571396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357dfe8-43e7-4731-9148-49e73397db5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:40.617361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b357dfe8-43e7-4731-9148-49e73397db5b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:40.618715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b357dfe8-43e7-4731-9148-49e73397db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:40.631962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9db13dcf-15c5-4f14-a209-2f276a6ca174 None None] MFA Rules not processed for user `cb1cee30bc59446d882880d978b78bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:40.633731 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9db13dcf-15c5-4f14-a209-2f276a6ca174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:40.785944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 842/1701] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:49:40.787028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357dfe8-43e7-4731-9148-49e73397db5b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:40.788467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b357dfe8-43e7-4731-9148-49e73397db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:40.816502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 860/1702] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:40.818759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b12e-9b47-4b20-afb7-d196708f693e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:40.819273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b12e-9b47-4b20-afb7-d196708f693e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:40.819741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b12e-9b47-4b20-afb7-d196708f693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:40.859767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6238b12e-9b47-4b20-afb7-d196708f693e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:40.865266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357dfe8-43e7-4731-9148-49e73397db5b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:40.869199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea70373-ab1d-4834-9c23-469724441ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:40.869841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea70373-ab1d-4834-9c23-469724441ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:40.870123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea70373-ab1d-4834-9c23-469724441ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:40.870398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea70373-ab1d-4834-9c23-469724441ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:40.872298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-aea70373-ab1d-4834-9c23-469724441ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:40.875236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6238b12e-9b47-4b20-afb7-d196708f693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:40.915606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea70373-ab1d-4834-9c23-469724441ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:40.918948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 861/1703] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:40.920592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786573-1261-46e8-906c-ceb1af490d37 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:40.921034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786573-1261-46e8-906c-ceb1af490d37 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:40.921373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786573-1261-46e8-906c-ceb1af490d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:40.921556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea70373-ab1d-4834-9c23-469724441ed6 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:40.940081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 843/1704] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:40.960087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea70373-ab1d-4834-9c23-469724441ed6 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:40.987248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea70373-ab1d-4834-9c23-469724441ed6 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:40.990306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-47786573-1261-46e8-906c-ceb1af490d37 None None] MFA Rules not processed for user `cb1cee30bc59446d882880d978b78bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:40.991588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-47786573-1261-46e8-906c-ceb1af490d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:40.999256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049a72-bcce-48c4-9519-34c260ad83eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:41.000072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049a72-bcce-48c4-9519-34c260ad83eb admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:41.000677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049a72-bcce-48c4-9519-34c260ad83eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:41.001147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049a72-bcce-48c4-9519-34c260ad83eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:41.002069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df049a72-bcce-48c4-9519-34c260ad83eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:41.002517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df049a72-bcce-48c4-9519-34c260ad83eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:41.007465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df049a72-bcce-48c4-9519-34c260ad83eb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:41.026540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 862/1705] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:41.039499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47786573-1261-46e8-906c-ceb1af490d37 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:41.040942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-47786573-1261-46e8-906c-ceb1af490d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:41.050307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 844/1706] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:41.056234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049a72-bcce-48c4-9519-34c260ad83eb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:41.078319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049a72-bcce-48c4-9519-34c260ad83eb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:41.097904 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e35a-d949-4ce4-9b71-186e5af8c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:41.099784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e35a-d949-4ce4-9b71-186e5af8c38b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:41.100927 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e35a-d949-4ce4-9b71-186e5af8c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:41.101348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e35a-d949-4ce4-9b71-186e5af8c38b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:41.102386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265e35a-d949-4ce4-9b71-186e5af8c38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:41.105007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265e35a-d949-4ce4-9b71-186e5af8c38b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:41.159683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 845/1707] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:41 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:41.163963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e35a-d949-4ce4-9b71-186e5af8c38b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:41.201293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:41.241861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47786573-1261-46e8-906c-ceb1af490d37 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:41.264625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e35a-d949-4ce4-9b71-186e5af8c38b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:41.275794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b57f5-b01b-453f-8426-2babbc60585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:41.277565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b57f5-b01b-453f-8426-2babbc60585c admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:41.278558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b57f5-b01b-453f-8426-2babbc60585c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:41.280488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b57f5-b01b-453f-8426-2babbc60585c admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:41.282533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b57f5-b01b-453f-8426-2babbc60585c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:41.291019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b57f5-b01b-453f-8426-2babbc60585c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:41.353698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 846/1708] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:41 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:49:41.356666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b57f5-b01b-453f-8426-2babbc60585c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:41.373571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:41.379671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b57f5-b01b-453f-8426-2babbc60585c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:41.394121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c248e31-e123-43f9-a7e5-3478ace10115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:41.395171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c248e31-e123-43f9-a7e5-3478ace10115 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:41.395759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c248e31-e123-43f9-a7e5-3478ace10115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:41.396698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c248e31-e123-43f9-a7e5-3478ace10115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:41.401398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c248e31-e123-43f9-a7e5-3478ace10115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:41.403446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c248e31-e123-43f9-a7e5-3478ace10115 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:41.403570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8ec79-9cf5-4d18-9342-cc4b38362fd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:41.404394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8ec79-9cf5-4d18-9342-cc4b38362fd1 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:41.404394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8ec79-9cf5-4d18-9342-cc4b38362fd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:41.404653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8ec79-9cf5-4d18-9342-cc4b38362fd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:41.439363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 847/1709] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:41.441367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c248e31-e123-43f9-a7e5-3478ace10115 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:41.481649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c248e31-e123-43f9-a7e5-3478ace10115 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:41.493065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f8f92-898d-4fb5-b6d7-502b7280a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:41.493707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f8f92-898d-4fb5-b6d7-502b7280a60e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:41.493989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f8f92-898d-4fb5-b6d7-502b7280a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:41.494266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f8f92-898d-4fb5-b6d7-502b7280a60e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:41.495027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f8f92-898d-4fb5-b6d7-502b7280a60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:41.497922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f8f92-898d-4fb5-b6d7-502b7280a60e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:41.514970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 848/1710] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:41.516542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f8f92-898d-4fb5-b6d7-502b7280a60e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:41.545939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f8f92-898d-4fb5-b6d7-502b7280a60e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:41.563664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eb221-16d8-4c93-8bef-51711681d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:41.564650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eb221-16d8-4c93-8bef-51711681d42c admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:41.565093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eb221-16d8-4c93-8bef-51711681d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:41.565522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eb221-16d8-4c93-8bef-51711681d42c admin admin] PATH_INFO: `/v3/projects/7a380e9224e1479190868b677a88e3c3/users/9197bb8a14f14754a217eee0ab587287/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:41.571767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8ec79-9cf5-4d18-9342-cc4b38362fd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:41.579987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8ec79-9cf5-4d18-9342-cc4b38362fd1 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:41.604833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 863/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:49:41.606710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eb221-16d8-4c93-8bef-51711681d42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a380e9224e1479190868b677a88e3c3, user_id=9197bb8a14f14754a217eee0ab587287, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:41.612955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eb221-16d8-4c93-8bef-51711681d42c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:41.645027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 849/1712] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:41 2022] PUT /identity/v3/projects/7a380e9224e1479190868b677a88e3c3/users/9197bb8a14f14754a217eee0ab587287/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:41.656730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6dbe-1318-4181-b3f9-d8fab1e041ff None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:41.657091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6dbe-1318-4181-b3f9-d8fab1e041ff None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:41.657443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6dbe-1318-4181-b3f9-d8fab1e041ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:41.734334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-91bf6dbe-1318-4181-b3f9-d8fab1e041ff None None] MFA Rules not processed for user `9197bb8a14f14754a217eee0ab587287`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:41.735919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-91bf6dbe-1318-4181-b3f9-d8fab1e041ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:41.903632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 864/1713] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:41.907915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eb221-16d8-4c93-8bef-51711681d42c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:42.064278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eb221-16d8-4c93-8bef-51711681d42c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:42.089589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4209cfd-f955-4e5b-beeb-96e8ae99c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:42.090403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4209cfd-f955-4e5b-beeb-96e8ae99c571 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:42.090695 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4209cfd-f955-4e5b-beeb-96e8ae99c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:42.090991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4209cfd-f955-4e5b-beeb-96e8ae99c571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:42.091699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4209cfd-f955-4e5b-beeb-96e8ae99c571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:42.093657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4209cfd-f955-4e5b-beeb-96e8ae99c571 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:42.171888 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 850/1714] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:41 2022] POST /identity/v3/projects => generated 369 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:42.176997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf6dbe-1318-4181-b3f9-d8fab1e041ff None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:42.197236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf6dbe-1318-4181-b3f9-d8fab1e041ff None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:42.336682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfe1f-5d9d-4766-8a0f-e6543ad47eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:42.337408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfe1f-5d9d-4766-8a0f-e6543ad47eba admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:42.340119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfe1f-5d9d-4766-8a0f-e6543ad47eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:42.340652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfe1f-5d9d-4766-8a0f-e6543ad47eba admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:42.342383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cfe1f-5d9d-4766-8a0f-e6543ad47eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:42.348858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cfe1f-5d9d-4766-8a0f-e6543ad47eba admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:42.406959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 865/1715] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:42 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:42.412479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4209cfd-f955-4e5b-beeb-96e8ae99c571 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:42.434158 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4209cfd-f955-4e5b-beeb-96e8ae99c571 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:42.446666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395c12d-bda2-4ccd-9e80-97e13b254c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:42.447845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395c12d-bda2-4ccd-9e80-97e13b254c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:42.448455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395c12d-bda2-4ccd-9e80-97e13b254c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:42.449321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395c12d-bda2-4ccd-9e80-97e13b254c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:42.450673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395c12d-bda2-4ccd-9e80-97e13b254c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:42.457311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395c12d-bda2-4ccd-9e80-97e13b254c57 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:42.491927 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 851/1716] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:42.496614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfe1f-5d9d-4766-8a0f-e6543ad47eba admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:42.515804 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfe1f-5d9d-4766-8a0f-e6543ad47eba admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:42.528655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d67687-f7e5-4951-b86c-144443e249c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:42.531547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d67687-f7e5-4951-b86c-144443e249c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:42.531547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d67687-f7e5-4951-b86c-144443e249c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:42.531869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d67687-f7e5-4951-b86c-144443e249c6 admin admin] PATH_INFO: `/v3/projects/4eca81f88e79449f8a173055182a5468/users/ad56e5ca41114061b83964682c250dbb/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:42.569882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:42.578195 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d67687-f7e5-4951-b86c-144443e249c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eca81f88e79449f8a173055182a5468, user_id=ad56e5ca41114061b83964682c250dbb, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:42.587200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d67687-f7e5-4951-b86c-144443e249c6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:42.608653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 866/1717] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:42 2022] PUT /identity/v3/projects/4eca81f88e79449f8a173055182a5468/users/ad56e5ca41114061b83964682c250dbb/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:42.612450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395c12d-bda2-4ccd-9e80-97e13b254c57 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:42.637960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395c12d-bda2-4ccd-9e80-97e13b254c57 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:42.737390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:42.805014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b064e3-e8ba-4f5d-93f0-3a7b1be5e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:42.805664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b064e3-e8ba-4f5d-93f0-3a7b1be5e846 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:42.805943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b064e3-e8ba-4f5d-93f0-3a7b1be5e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:42.806208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b064e3-e8ba-4f5d-93f0-3a7b1be5e846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:42.807321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b064e3-e8ba-4f5d-93f0-3a7b1be5e846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:42.808565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b064e3-e8ba-4f5d-93f0-3a7b1be5e846 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:42.830202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 852/1718] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:42.834910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d67687-f7e5-4951-b86c-144443e249c6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:42.853374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d67687-f7e5-4951-b86c-144443e249c6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:42.868860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797946-c3ea-4ccc-a772-71c11c4f0079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:42.869565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797946-c3ea-4ccc-a772-71c11c4f0079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:42.869849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797946-c3ea-4ccc-a772-71c11c4f0079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:42.870127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797946-c3ea-4ccc-a772-71c11c4f0079 admin admin] PATH_INFO: `/v3/projects/4eca81f88e79449f8a173055182a5468/users/ad56e5ca41114061b83964682c250dbb/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:42.880582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce797946-c3ea-4ccc-a772-71c11c4f0079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eca81f88e79449f8a173055182a5468, user_id=ad56e5ca41114061b83964682c250dbb, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:42.883420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce797946-c3ea-4ccc-a772-71c11c4f0079 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:42.922667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 867/1719] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:42 2022] PUT /identity/v3/projects/4eca81f88e79449f8a173055182a5468/users/ad56e5ca41114061b83964682c250dbb/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:42.924952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546270b-cfa8-42d9-8d33-87ba0af3242c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:42.925311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546270b-cfa8-42d9-8d33-87ba0af3242c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:42.925711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546270b-cfa8-42d9-8d33-87ba0af3242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:42.991556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7546270b-cfa8-42d9-8d33-87ba0af3242c None None] MFA Rules not processed for user `ad56e5ca41114061b83964682c250dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:42.992867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7546270b-cfa8-42d9-8d33-87ba0af3242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:43.201769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 853/1720] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:43.213805 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797946-c3ea-4ccc-a772-71c11c4f0079 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:43.215932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ce797946-c3ea-4ccc-a772-71c11c4f0079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:43.311734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158ff33-aed3-40bd-b6ce-7024d8970f9c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:43.312027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158ff33-aed3-40bd-b6ce-7024d8970f9c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:43.312334 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158ff33-aed3-40bd-b6ce-7024d8970f9c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:43.314389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 854/1721] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jul 27 07:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:49:43.320730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b29915-7f00-4dd1-aabf-1748713be375 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:43.321066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b29915-7f00-4dd1-aabf-1748713be375 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:43.321339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b29915-7f00-4dd1-aabf-1748713be375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:43.383872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797946-c3ea-4ccc-a772-71c11c4f0079 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:43.393417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef4232-fb04-4d9a-b1dd-e6e134027ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:43.394171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef4232-fb04-4d9a-b1dd-e6e134027ebb service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:43.396698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-99b29915-7f00-4dd1-aabf-1748713be375 None None] MFA Rules not processed for user `0c65277d89a24081a47a7f928f6c6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:43.398201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef4232-fb04-4d9a-b1dd-e6e134027ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:43.400757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-99b29915-7f00-4dd1-aabf-1748713be375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:43.401398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef4232-fb04-4d9a-b1dd-e6e134027ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:43.446846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef4232-fb04-4d9a-b1dd-e6e134027ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:43.448362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef4232-fb04-4d9a-b1dd-e6e134027ebb service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:43.483385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 868/1722] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:49:43.484467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef4232-fb04-4d9a-b1dd-e6e134027ebb service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:43.486990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-daef4232-fb04-4d9a-b1dd-e6e134027ebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:43.599975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 855/1723] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:49:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:49:43.601233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1a440-7ebf-4a04-8316-fbf6d745453f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:43.602221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1a440-7ebf-4a04-8316-fbf6d745453f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:43.602576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1a440-7ebf-4a04-8316-fbf6d745453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:43.686160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef4232-fb04-4d9a-b1dd-e6e134027ebb service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:43.696832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:43.699233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:43.699521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:43.699698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-64b1a440-7ebf-4a04-8316-fbf6d745453f None None] MFA Rules not processed for user `be2d0a6b52c8465a8ae2f46d1270ae38`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:43.699803 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] PATH_INFO: `/v3/projects/4bcb60ba6e13498a988439731d377f1f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:43.701227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-64b1a440-7ebf-4a04-8316-fbf6d745453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:43.704235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcb60ba6e13498a988439731d377f1f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:43.706963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:43.846671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:43.857509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcb60ba6e13498a988439731d377f1f', 'request_id': 'req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:43.878499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcb60ba6e13498a988439731d377f1f', 'request_id': 'req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:43.893041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcb60ba6e13498a988439731d377f1f', 'request_id': 'req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:43.908521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] The token cache is being invalidate because project 4bcb60ba6e13498a988439731d377f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:43.908985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:43.909146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 856/1724] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:43.909670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:43.910846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1a440-7ebf-4a04-8316-fbf6d745453f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:43.911647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 869/1725] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:43 2022] DELETE /identity/v3/projects/4bcb60ba6e13498a988439731d377f1f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:43.921562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:43.921562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:43.924001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-64b1a440-7ebf-4a04-8316-fbf6d745453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:43.935646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:43.950434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1a440-7ebf-4a04-8316-fbf6d745453f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:44.037876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b2bcb-0936-4911-89b7-7ae4a0c24fc5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:44.045640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca503b6-3eaa-4ef2-b6e7-b8473941cf0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:44.046444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca503b6-3eaa-4ef2-b6e7-b8473941cf0d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:44.046730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca503b6-3eaa-4ef2-b6e7-b8473941cf0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:44.047048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca503b6-3eaa-4ef2-b6e7-b8473941cf0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:44.053300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fca503b6-3eaa-4ef2-b6e7-b8473941cf0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:44.077715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:44.079161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:44.079884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:44.080346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] PATH_INFO: `/v3/users/91422a184dd94321ac6a4e7278c4a99f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:44.081268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca503b6-3eaa-4ef2-b6e7-b8473941cf0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:44.084956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca503b6-3eaa-4ef2-b6e7-b8473941cf0d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:44.086350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] RBAC: Authorizing `identity:delete_user(user_id=91422a184dd94321ac6a4e7278c4a99f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:44.088399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:44.102470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 870/1726] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:44.104713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df5ee-3a49-44e4-8f8b-1d6b14480e71 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:44.105172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df5ee-3a49-44e4-8f8b-1d6b14480e71 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:44.105607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df5ee-3a49-44e4-8f8b-1d6b14480e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:44.141124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-264df5ee-3a49-44e4-8f8b-1d6b14480e71 None None] MFA Rules not processed for user `be2d0a6b52c8465a8ae2f46d1270ae38`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:44.143895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-264df5ee-3a49-44e4-8f8b-1d6b14480e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:44.158399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91422a184dd94321ac6a4e7278c4a99f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:44.186699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91422a184dd94321ac6a4e7278c4a99f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:44.187645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91422a184dd94321ac6a4e7278c4a99f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:44.202523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91422a184dd94321ac6a4e7278c4a99f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:44.204647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-64c78a15-2604-46de-bb72-5aa9273d101b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91422a184dd94321ac6a4e7278c4a99f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:44.247200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 857/1727] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:43 2022] DELETE /identity/v3/users/91422a184dd94321ac6a4e7278c4a99f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:44.248940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da05323-844c-4f7c-b4bd-99873a19598b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:44.249346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da05323-844c-4f7c-b4bd-99873a19598b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:44.249779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da05323-844c-4f7c-b4bd-99873a19598b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:44.278072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2da05323-844c-4f7c-b4bd-99873a19598b None None] MFA Rules not processed for user `7e3a5b392d9d44859110f048bea7331b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:44.279604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2da05323-844c-4f7c-b4bd-99873a19598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:44.298942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 871/1728] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:44.306316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf28b7-6d75-4a5c-9b27-5d71fbc55ad8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:44.306638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf28b7-6d75-4a5c-9b27-5d71fbc55ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:44.306968 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf28b7-6d75-4a5c-9b27-5d71fbc55ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:44.368040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1caf28b7-6d75-4a5c-9b27-5d71fbc55ad8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:44.375104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1caf28b7-6d75-4a5c-9b27-5d71fbc55ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:44.395849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 858/1729] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:44.404299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb398d2-c294-430a-8267-fa7daa1c4c93 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:44.405833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb398d2-c294-430a-8267-fa7daa1c4c93 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:44.406372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb398d2-c294-430a-8267-fa7daa1c4c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:44.470384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2eb398d2-c294-430a-8267-fa7daa1c4c93 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:44.471607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2eb398d2-c294-430a-8267-fa7daa1c4c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:44.485219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:44.631242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 872/1730] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:44.632522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf28b7-6d75-4a5c-9b27-5d71fbc55ad8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:44.666943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1caf28b7-6d75-4a5c-9b27-5d71fbc55ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:44.700004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 859/1731] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:44.700004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50130c2-2a56-4e3f-9d33-8b22add9d1df None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:44.705928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50130c2-2a56-4e3f-9d33-8b22add9d1df None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:44.706269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50130c2-2a56-4e3f-9d33-8b22add9d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:44.753576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c50130c2-2a56-4e3f-9d33-8b22add9d1df None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:44.755047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c50130c2-2a56-4e3f-9d33-8b22add9d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:44.797154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 860/1732] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:44.798137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50130c2-2a56-4e3f-9d33-8b22add9d1df None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:44.806802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c50130c2-2a56-4e3f-9d33-8b22add9d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:44.944306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:44.960965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50130c2-2a56-4e3f-9d33-8b22add9d1df None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:44.972653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf87dd-58d2-4ae4-a3d3-f00964ab12dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:44.973312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf87dd-58d2-4ae4-a3d3-f00964ab12dd service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:44.973777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf87dd-58d2-4ae4-a3d3-f00964ab12dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:44.974345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf87dd-58d2-4ae4-a3d3-f00964ab12dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.000327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf87dd-58d2-4ae4-a3d3-f00964ab12dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:45.002250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf87dd-58d2-4ae4-a3d3-f00964ab12dd service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:45.005858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf28b7-6d75-4a5c-9b27-5d71fbc55ad8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:45.018795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445604b6-e744-4f84-9dbe-e9827b8be797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:45.019431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445604b6-e744-4f84-9dbe-e9827b8be797 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.019727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445604b6-e744-4f84-9dbe-e9827b8be797 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.019938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445604b6-e744-4f84-9dbe-e9827b8be797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.024139 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-445604b6-e744-4f84-9dbe-e9827b8be797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:45.027266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 861/1733] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:45.028308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf87dd-58d2-4ae4-a3d3-f00964ab12dd service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:45.062235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf87dd-58d2-4ae4-a3d3-f00964ab12dd service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:45.074375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703b451-77b2-43b9-a507-bc83ac0e1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:45.076562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703b451-77b2-43b9-a507-bc83ac0e1681 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.076562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703b451-77b2-43b9-a507-bc83ac0e1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.076562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703b451-77b2-43b9-a507-bc83ac0e1681 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.077651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703b451-77b2-43b9-a507-bc83ac0e1681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:45.077968 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703b451-77b2-43b9-a507-bc83ac0e1681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:45.083538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703b451-77b2-43b9-a507-bc83ac0e1681 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:45.109987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 862/1734] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:45.119421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703b451-77b2-43b9-a507-bc83ac0e1681 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:45.137015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703b451-77b2-43b9-a507-bc83ac0e1681 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:45.156447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e31224-7e2e-4b15-b4e7-a93fe093daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:45.157350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e31224-7e2e-4b15-b4e7-a93fe093daa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.157567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e31224-7e2e-4b15-b4e7-a93fe093daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.157930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e31224-7e2e-4b15-b4e7-a93fe093daa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.159425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e31224-7e2e-4b15-b4e7-a93fe093daa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:45.165636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e31224-7e2e-4b15-b4e7-a93fe093daa9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:45.235705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 863/1735] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:45 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:49:45.236261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e31224-7e2e-4b15-b4e7-a93fe093daa9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:45.242555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445604b6-e744-4f84-9dbe-e9827b8be797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:45.244445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445604b6-e744-4f84-9dbe-e9827b8be797 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:45.291387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 873/1736] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:45.344330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1962c9-1384-44e2-9884-43658609c8a4 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.344890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1962c9-1384-44e2-9884-43658609c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.344890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1962c9-1384-44e2-9884-43658609c8a4 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.346533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 874/1737] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jul 27 07:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:49:45.358310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd34867-ea64-4d15-9b82-0a7966cd05a2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.358592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd34867-ea64-4d15-9b82-0a7966cd05a2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.358862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd34867-ea64-4d15-9b82-0a7966cd05a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.433869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5cd34867-ea64-4d15-9b82-0a7966cd05a2 None None] MFA Rules not processed for user `beaec3b392e3468981992629101cf883`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:45.435146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5cd34867-ea64-4d15-9b82-0a7966cd05a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:45.467779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e31224-7e2e-4b15-b4e7-a93fe093daa9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:45.487910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24744a8-a5ff-4a93-9e2d-49353d8a4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:45.488562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24744a8-a5ff-4a93-9e2d-49353d8a4928 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.488841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24744a8-a5ff-4a93-9e2d-49353d8a4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.489113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24744a8-a5ff-4a93-9e2d-49353d8a4928 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.490344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24744a8-a5ff-4a93-9e2d-49353d8a4928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:45.514113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24744a8-a5ff-4a93-9e2d-49353d8a4928 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:45.594747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:45.616017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 864/1738] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:45 2022] POST /identity/v3/users => generated 295 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:45.619924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24744a8-a5ff-4a93-9e2d-49353d8a4928 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:45.645062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 875/1739] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jul 27 07:49:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:45.655210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24744a8-a5ff-4a93-9e2d-49353d8a4928 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:45.656050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd34867-ea64-4d15-9b82-0a7966cd05a2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:45.675665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637621-76a9-466b-b8b8-397d50ee52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:45.677840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637621-76a9-466b-b8b8-397d50ee52ec admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.677840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637621-76a9-466b-b8b8-397d50ee52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.678023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637621-76a9-466b-b8b8-397d50ee52ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.678634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e637621-76a9-466b-b8b8-397d50ee52ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:45.683571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e637621-76a9-466b-b8b8-397d50ee52ec admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:45.684047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd34867-ea64-4d15-9b82-0a7966cd05a2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:45.702662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a32629-e360-456e-a463-5491911879c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:45.703131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a32629-e360-456e-a463-5491911879c0 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.703884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a32629-e360-456e-a463-5491911879c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.705387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a32629-e360-456e-a463-5491911879c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.710206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a2a32629-e360-456e-a463-5491911879c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:45.716217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 865/1740] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:45.718753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637621-76a9-466b-b8b8-397d50ee52ec admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:45.745543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637621-76a9-466b-b8b8-397d50ee52ec admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:45.770105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c988f-a805-4e54-b1fa-8933ebf51a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:45.772703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a32629-e360-456e-a463-5491911879c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:45.774730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a32629-e360-456e-a463-5491911879c0 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:45.783763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c988f-a805-4e54-b1fa-8933ebf51a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.784105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c988f-a805-4e54-b1fa-8933ebf51a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.784382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c988f-a805-4e54-b1fa-8933ebf51a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.785144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c988f-a805-4e54-b1fa-8933ebf51a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:45.787463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c988f-a805-4e54-b1fa-8933ebf51a1a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:45.797993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 876/1741] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:45.845372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 866/1742] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:45.850652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a32629-e360-456e-a463-5491911879c0 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:45.880792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a32629-e360-456e-a463-5491911879c0 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:45.897082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be50a3-dbd4-4fb6-9e9f-b205e5e4fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:45.897824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be50a3-dbd4-4fb6-9e9f-b205e5e4fc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.898101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be50a3-dbd4-4fb6-9e9f-b205e5e4fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.898429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be50a3-dbd4-4fb6-9e9f-b205e5e4fc76 admin admin] PATH_INFO: `/v3/projects/364f8aeb05634e389dfdabc209faf7b9/users/322fac7363354d8eaf104971a693b670/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:45.933107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be50a3-dbd4-4fb6-9e9f-b205e5e4fc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364f8aeb05634e389dfdabc209faf7b9, user_id=322fac7363354d8eaf104971a693b670, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:45.935980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be50a3-dbd4-4fb6-9e9f-b205e5e4fc76 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:45.985215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 877/1743] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:45 2022] PUT /identity/v3/projects/364f8aeb05634e389dfdabc209faf7b9/users/322fac7363354d8eaf104971a693b670/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:45.998369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207ca4b-8bb8-456b-af7d-9dee9c51fd21 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:45.999220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207ca4b-8bb8-456b-af7d-9dee9c51fd21 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:45.999502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207ca4b-8bb8-456b-af7d-9dee9c51fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:46.071840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5207ca4b-8bb8-456b-af7d-9dee9c51fd21 None None] MFA Rules not processed for user `322fac7363354d8eaf104971a693b670`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:46.073165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5207ca4b-8bb8-456b-af7d-9dee9c51fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:46.332482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 867/1744] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:46.337678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be50a3-dbd4-4fb6-9e9f-b205e5e4fc76 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:46.525935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:46.540200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be50a3-dbd4-4fb6-9e9f-b205e5e4fc76 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:46.559860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b67da-64ea-4f08-b060-6ecaf61dabbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:46.560510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b67da-64ea-4f08-b060-6ecaf61dabbc admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:46.560850 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b67da-64ea-4f08-b060-6ecaf61dabbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:46.561140 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b67da-64ea-4f08-b060-6ecaf61dabbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:46.561875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b67da-64ea-4f08-b060-6ecaf61dabbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:46.564623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b67da-64ea-4f08-b060-6ecaf61dabbc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:46.656175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 878/1745] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:46 2022] POST /identity/v3/projects => generated 387 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:46.656658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207ca4b-8bb8-456b-af7d-9dee9c51fd21 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:46.670779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207ca4b-8bb8-456b-af7d-9dee9c51fd21 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:46.772000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b67da-64ea-4f08-b060-6ecaf61dabbc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:46.773969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-345b67da-64ea-4f08-b060-6ecaf61dabbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:46.899446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28dbae-cd9d-4d21-a95b-15bcd7cbcb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:46.900944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28dbae-cd9d-4d21-a95b-15bcd7cbcb87 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:46.901507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28dbae-cd9d-4d21-a95b-15bcd7cbcb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:46.901933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28dbae-cd9d-4d21-a95b-15bcd7cbcb87 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:46.903482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28dbae-cd9d-4d21-a95b-15bcd7cbcb87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:46.908583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28dbae-cd9d-4d21-a95b-15bcd7cbcb87 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:46.980065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 868/1746] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:46 2022] POST /identity/v3/users => generated 300 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:49:46.982105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28dbae-cd9d-4d21-a95b-15bcd7cbcb87 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:47.012880 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b67da-64ea-4f08-b060-6ecaf61dabbc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:47.033485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:47.035653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:47.041063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:47.041479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] PATH_INFO: `/v3/users/9197bb8a14f14754a217eee0ab587287` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:47.045598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28dbae-cd9d-4d21-a95b-15bcd7cbcb87 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:47.049641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9197bb8a14f14754a217eee0ab587287)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:47.052253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:47.095952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e824d9e-21ce-433a-95a0-6e37a85a45aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:47.097135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e824d9e-21ce-433a-95a0-6e37a85a45aa admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:47.097640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e824d9e-21ce-433a-95a0-6e37a85a45aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:47.098201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e824d9e-21ce-433a-95a0-6e37a85a45aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:47.100042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e824d9e-21ce-433a-95a0-6e37a85a45aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:47.102020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e824d9e-21ce-433a-95a0-6e37a85a45aa admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:47.166527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 869/1747] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:47.167648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e824d9e-21ce-433a-95a0-6e37a85a45aa admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:47.198567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e824d9e-21ce-433a-95a0-6e37a85a45aa admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:47.214214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18706671-0426-4f48-b486-bdca318c0d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:47.215529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18706671-0426-4f48-b486-bdca318c0d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:47.216200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18706671-0426-4f48-b486-bdca318c0d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:47.216694 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18706671-0426-4f48-b486-bdca318c0d6f admin admin] PATH_INFO: `/v3/projects/175de7ec70b04aa297141b58d3e0f69b/users/9df296e8ed4642c9a6c7e8c31a32f55b/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:47.248098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18706671-0426-4f48-b486-bdca318c0d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=175de7ec70b04aa297141b58d3e0f69b, user_id=9df296e8ed4642c9a6c7e8c31a32f55b, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:47.255097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18706671-0426-4f48-b486-bdca318c0d6f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:47.269071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9197bb8a14f14754a217eee0ab587287'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:47.303485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9197bb8a14f14754a217eee0ab587287'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:47.304402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 870/1748] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:47 2022] PUT /identity/v3/projects/175de7ec70b04aa297141b58d3e0f69b/users/9df296e8ed4642c9a6c7e8c31a32f55b/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:47.319514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba192f-89a6-4849-85bc-15c072619af8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:47.319514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba192f-89a6-4849-85bc-15c072619af8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:47.319806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba192f-89a6-4849-85bc-15c072619af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:47.364127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9197bb8a14f14754a217eee0ab587287'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:47.365189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9197bb8a14f14754a217eee0ab587287'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:47.395265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9197bb8a14f14754a217eee0ab587287'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:47.417404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 879/1749] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:46 2022] DELETE /identity/v3/users/9197bb8a14f14754a217eee0ab587287 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:47.418578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:47.425878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:47.445342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a8ba192f-89a6-4849-85bc-15c072619af8 None None] MFA Rules not processed for user `cb1cee30bc59446d882880d978b78bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:47.452933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a8ba192f-89a6-4849-85bc-15c072619af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:47.524788 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:47.618604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 871/1750] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:47.619802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8609b8-19a5-4c20-a734-f80bcd356ccb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:47.620017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8609b8-19a5-4c20-a734-f80bcd356ccb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:47.620295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8609b8-19a5-4c20-a734-f80bcd356ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:47.660009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c5272-1bc1-4026-bc14-a5083eba9988 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:47.671081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5e9d7-eef6-4cde-a167-6204f03f7de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:47.671711 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e9d7-eef6-4cde-a167-6204f03f7de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:47.672127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e9d7-eef6-4cde-a167-6204f03f7de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:47.672400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e9d7-eef6-4cde-a167-6204f03f7de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:47.673492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5e9d7-eef6-4cde-a167-6204f03f7de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:47.675623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5e9d7-eef6-4cde-a167-6204f03f7de1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:47.677392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:47.678108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5b8609b8-19a5-4c20-a734-f80bcd356ccb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:47.683066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5b8609b8-19a5-4c20-a734-f80bcd356ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:47.715802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 872/1751] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:47.725178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 880/1752] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:47.735791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8609b8-19a5-4c20-a734-f80bcd356ccb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:47.736334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1191a5-8539-414e-822e-672e6e23540f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:47.736621 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1191a5-8539-414e-822e-672e6e23540f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:47.737432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1191a5-8539-414e-822e-672e6e23540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:47.772030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8609b8-19a5-4c20-a734-f80bcd356ccb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:47.794600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe86d8e-6a46-4b1d-9b44-07afd91814e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:47.796911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe86d8e-6a46-4b1d-9b44-07afd91814e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:47.801475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe86d8e-6a46-4b1d-9b44-07afd91814e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:47.802555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe86d8e-6a46-4b1d-9b44-07afd91814e0 admin admin] PATH_INFO: `/v3/projects/175de7ec70b04aa297141b58d3e0f69b/users/9df296e8ed4642c9a6c7e8c31a32f55b/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:47.814543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe86d8e-6a46-4b1d-9b44-07afd91814e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175de7ec70b04aa297141b58d3e0f69b, user_id=9df296e8ed4642c9a6c7e8c31a32f55b, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:47.818326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe86d8e-6a46-4b1d-9b44-07afd91814e0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:47.821315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bc1191a5-8539-414e-822e-672e6e23540f None None] MFA Rules not processed for user `eb3d3ca2457b47a29b7c94bd8be450cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:47.826462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bc1191a5-8539-414e-822e-672e6e23540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:47.865593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 873/1753] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:47 2022] PUT /identity/v3/projects/175de7ec70b04aa297141b58d3e0f69b/users/9df296e8ed4642c9a6c7e8c31a32f55b/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:47.875167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe86d8e-6a46-4b1d-9b44-07afd91814e0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:47.885094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cfe86d8e-6a46-4b1d-9b44-07afd91814e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:48.050971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe86d8e-6a46-4b1d-9b44-07afd91814e0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:48.065325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0fe53-131a-4eaa-846f-df6345a16e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:48.066533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0fe53-131a-4eaa-846f-df6345a16e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:48.066533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0fe53-131a-4eaa-846f-df6345a16e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:48.067065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0fe53-131a-4eaa-846f-df6345a16e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:48.134309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 881/1754] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:48.136317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd8ac-5415-4479-b74f-11ead06a1609 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:48.136767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd8ac-5415-4479-b74f-11ead06a1609 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:48.137186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd8ac-5415-4479-b74f-11ead06a1609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:48.218092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b66cd8ac-5415-4479-b74f-11ead06a1609 None None] MFA Rules not processed for user `9df296e8ed4642c9a6c7e8c31a32f55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:48.218453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b66cd8ac-5415-4479-b74f-11ead06a1609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:48.270438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0fe53-131a-4eaa-846f-df6345a16e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:48.271947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0fe53-131a-4eaa-846f-df6345a16e7a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:48.306535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 874/1755] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:48.414447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 882/1756] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:48.430854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0fe53-131a-4eaa-846f-df6345a16e7a service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:48.433417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b6b0fe53-131a-4eaa-846f-df6345a16e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:48.559619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a060-0170-43e2-8f60-4ec0295d8ee6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:48.559964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a060-0170-43e2-8f60-4ec0295d8ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:48.560249 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a060-0170-43e2-8f60-4ec0295d8ee6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:48.562333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 883/1757] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jul 27 07:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:49:48.573015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5a487-9e22-4146-9e95-a671c3b6722e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:48.573378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5a487-9e22-4146-9e95-a671c3b6722e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:48.573729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5a487-9e22-4146-9e95-a671c3b6722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:48.628299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-23b5a487-9e22-4146-9e95-a671c3b6722e None None] MFA Rules not processed for user `0c65277d89a24081a47a7f928f6c6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:48.629574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-23b5a487-9e22-4146-9e95-a671c3b6722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:48.662722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 884/1758] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:49:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:48.668795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0fe53-131a-4eaa-846f-df6345a16e7a service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:48.681255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46842c9-f595-4e39-b5ca-d82eaa40f56a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:48.682020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46842c9-f595-4e39-b5ca-d82eaa40f56a service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:48.682638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46842c9-f595-4e39-b5ca-d82eaa40f56a service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:48.682638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46842c9-f595-4e39-b5ca-d82eaa40f56a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:48.711361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46842c9-f595-4e39-b5ca-d82eaa40f56a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:48.713041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46842c9-f595-4e39-b5ca-d82eaa40f56a service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:48.727370 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:48.747250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 875/1759] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:48.756985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5a487-9e22-4146-9e95-a671c3b6722e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:48.758873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-23b5a487-9e22-4146-9e95-a671c3b6722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:48.787420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5a487-9e22-4146-9e95-a671c3b6722e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:48.811059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60a1c-6277-4fd6-907c-71ce66d88133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:48.811713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60a1c-6277-4fd6-907c-71ce66d88133 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:48.811997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60a1c-6277-4fd6-907c-71ce66d88133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:48.812792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60a1c-6277-4fd6-907c-71ce66d88133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:48.839580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f60a1c-6277-4fd6-907c-71ce66d88133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:48.840991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f60a1c-6277-4fd6-907c-71ce66d88133 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:48.868030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 885/1760] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:49.003846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7359-e890-4b44-ad98-cccc49c8d5cd None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:49.004491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7359-e890-4b44-ad98-cccc49c8d5cd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:49.005404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7359-e890-4b44-ad98-cccc49c8d5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:49.094570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60a1c-6277-4fd6-907c-71ce66d88133 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:49.102756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-608f7359-e890-4b44-ad98-cccc49c8d5cd None None] MFA Rules not processed for user `df8fb928aa42413b9d03e83f46dd48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:49.104305 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-608f7359-e890-4b44-ad98-cccc49c8d5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:49.133929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60a1c-6277-4fd6-907c-71ce66d88133 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:49.202185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:49.207681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:49.208155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:49.213599 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] PATH_INFO: `/v3/users/322fac7363354d8eaf104971a693b670` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:49.217741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=322fac7363354d8eaf104971a693b670)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:49.228046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:49.336721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 876/1761] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:49.337935 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f7359-e890-4b44-ad98-cccc49c8d5cd None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:49.350817 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-608f7359-e890-4b44-ad98-cccc49c8d5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:49.450310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:49.451077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f7359-e890-4b44-ad98-cccc49c8d5cd None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:49.455701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322fac7363354d8eaf104971a693b670'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.465376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:49.466129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:49.466429 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:49.466771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] PATH_INFO: `/v3/projects/6983306995a64ff4960728195979eac4` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:49.468559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6983306995a64ff4960728195979eac4)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:49.483158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322fac7363354d8eaf104971a693b670'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.499366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:49.533123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322fac7363354d8eaf104971a693b670'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.534158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322fac7363354d8eaf104971a693b670'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.573134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322fac7363354d8eaf104971a693b670'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.601817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 886/1762] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:49 2022] DELETE /identity/v3/users/322fac7363354d8eaf104971a693b670 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:49.603900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:49.607436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:49.711582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6983306995a64ff4960728195979eac4', 'request_id': 'req-56eb879d-0855-41c0-8310-98f5a095a3c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.736138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6983306995a64ff4960728195979eac4', 'request_id': 'req-56eb879d-0855-41c0-8310-98f5a095a3c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.750730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6983306995a64ff4960728195979eac4', 'request_id': 'req-56eb879d-0855-41c0-8310-98f5a095a3c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.790221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] The token cache is being invalidate because project 6983306995a64ff4960728195979eac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:49.791954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.794095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:49.797536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 877/1763] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:49 2022] DELETE /identity/v3/projects/6983306995a64ff4960728195979eac4 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:49.800619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:49.820596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:49.852003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434320d1-9546-4229-8b44-850ba4c4bbe3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:50.034427 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e39cb6-f9ef-4064-a6ad-317e86ed7999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:50.035347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e39cb6-f9ef-4064-a6ad-317e86ed7999 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:50.035797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e39cb6-f9ef-4064-a6ad-317e86ed7999 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:50.036260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e39cb6-f9ef-4064-a6ad-317e86ed7999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:50.039010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f0e39cb6-f9ef-4064-a6ad-317e86ed7999 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:50.150947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb879d-0855-41c0-8310-98f5a095a3c7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:50.161238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:50.162308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:50.162758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:50.163215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] PATH_INFO: `/v3/projects/7a380e9224e1479190868b677a88e3c3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:50.165322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a380e9224e1479190868b677a88e3c3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:50.173037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:50.223322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:50.230151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e39cb6-f9ef-4064-a6ad-317e86ed7999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:50.233789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e39cb6-f9ef-4064-a6ad-317e86ed7999 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:50.245778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:50.264559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 887/1764] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:50.269176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0adc3-85b8-453d-9793-21009f98affe None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:50.270687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0adc3-85b8-453d-9793-21009f98affe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:50.271686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0adc3-85b8-453d-9793-21009f98affe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:50.322337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-40d0adc3-85b8-453d-9793-21009f98affe None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:50.324396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-40d0adc3-85b8-453d-9793-21009f98affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:50.357301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a380e9224e1479190868b677a88e3c3', 'request_id': 'req-0738ea64-b217-41a4-83eb-f8f3e9840ffd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.376909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a380e9224e1479190868b677a88e3c3', 'request_id': 'req-0738ea64-b217-41a4-83eb-f8f3e9840ffd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.398118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a380e9224e1479190868b677a88e3c3', 'request_id': 'req-0738ea64-b217-41a4-83eb-f8f3e9840ffd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.459431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 888/1765] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:50.463446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] The token cache is being invalidate because project 7a380e9224e1479190868b677a88e3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:50.464908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.468457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.477076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 878/1766] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:49 2022] DELETE /identity/v3/projects/7a380e9224e1479190868b677a88e3c3 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:50.480887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:50.483551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:50.490320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0adc3-85b8-453d-9793-21009f98affe None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:50.495643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-40d0adc3-85b8-453d-9793-21009f98affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:50.524473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0adc3-85b8-453d-9793-21009f98affe None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:50.538711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738ea64-b217-41a4-83eb-f8f3e9840ffd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:50.541202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:50.541711 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:50.541987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:50.542304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] PATH_INFO: `/v3/users/6edd1fd800294fcaa66dd2d9733d27be` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:50.549416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6edd1fd800294fcaa66dd2d9733d27be)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:50.556090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:50.562433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:50.567049 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:50.567397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:50.567762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] PATH_INFO: `/v3/users/ad56e5ca41114061b83964682c250dbb` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:50.575294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad56e5ca41114061b83964682c250dbb)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:50.581548 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:50.695261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad56e5ca41114061b83964682c250dbb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.717923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6edd1fd800294fcaa66dd2d9733d27be'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.725247 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad56e5ca41114061b83964682c250dbb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.726610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad56e5ca41114061b83964682c250dbb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.748062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6edd1fd800294fcaa66dd2d9733d27be'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.754372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad56e5ca41114061b83964682c250dbb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.763780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad56e5ca41114061b83964682c250dbb'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.796397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6edd1fd800294fcaa66dd2d9733d27be'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.798093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6edd1fd800294fcaa66dd2d9733d27be'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.799031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 879/1767] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:50 2022] DELETE /identity/v3/users/ad56e5ca41114061b83964682c250dbb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:50.804762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:50.809387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:50.814429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6edd1fd800294fcaa66dd2d9733d27be'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:50.832047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 889/1768] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:50 2022] DELETE /identity/v3/users/6edd1fd800294fcaa66dd2d9733d27be => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:50.833498 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:50.835610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:51.018382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab76ae-5ddf-410c-9be8-2d957d520227 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:51.092299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:51.142926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f38e16-69c7-498e-a4c5-43d8edee8582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:51.143669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f38e16-69c7-498e-a4c5-43d8edee8582 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:51.145943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f38e16-69c7-498e-a4c5-43d8edee8582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:51.146496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f38e16-69c7-498e-a4c5-43d8edee8582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:51.151710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-40f38e16-69c7-498e-a4c5-43d8edee8582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:51.225908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69deb0e-a608-46e2-9074-550de6fa44e2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:51.261527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:51.263031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:51.265901 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:51.273841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:51.284094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:51.307535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:51.392537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f38e16-69c7-498e-a4c5-43d8edee8582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:51.396722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f38e16-69c7-498e-a4c5-43d8edee8582 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:51.423808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 880/1769] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:51.425255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7d8b-5690-4ef8-8f8a-008558f77f8b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:51.425616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7d8b-5690-4ef8-8f8a-008558f77f8b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:51.425856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7d8b-5690-4ef8-8f8a-008558f77f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:51.534843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:51.548933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:51.582516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3ddb7d8b-5690-4ef8-8f8a-008558f77f8b None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:51.584368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3ddb7d8b-5690-4ef8-8f8a-008558f77f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:51.620943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 890/1770] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:51.852241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 881/1771] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:49:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:52.148602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:52.150572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:52.451127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fc28d-1ee4-4aa5-ac66-fca8aa9a9851 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:52.476672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05714f4-6115-42e7-abe4-365705f5559e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:52.477830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05714f4-6115-42e7-abe4-365705f5559e service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:52.478452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05714f4-6115-42e7-abe4-365705f5559e service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:52.478872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05714f4-6115-42e7-abe4-365705f5559e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:52.509015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05714f4-6115-42e7-abe4-365705f5559e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:52.510901 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05714f4-6115-42e7-abe4-365705f5559e service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:52.529622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 891/1772] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:49:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:49:53.287749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7d8b-5690-4ef8-8f8a-008558f77f8b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:53.289266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3ddb7d8b-5690-4ef8-8f8a-008558f77f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:53.353116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7d8b-5690-4ef8-8f8a-008558f77f8b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:53.384762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:53.385447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:53.385728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:53.386000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] PATH_INFO: `/v3/projects/4eca81f88e79449f8a173055182a5468` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:53.392901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eca81f88e79449f8a173055182a5468)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:53.406523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:53.590235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:53.593625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eca81f88e79449f8a173055182a5468', 'request_id': 'req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:53.617121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eca81f88e79449f8a173055182a5468', 'request_id': 'req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:53.633521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eca81f88e79449f8a173055182a5468', 'request_id': 'req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:53.675252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] The token cache is being invalidate because project 4eca81f88e79449f8a173055182a5468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:53.675252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:53.688285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a330f17-5dc3-4ad7-bfe9-8093497c22a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:53.697536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 882/1773] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:53 2022] DELETE /identity/v3/projects/4eca81f88e79449f8a173055182a5468 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:53.699282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c0f1-1bbd-44ad-acee-2eec7a2f9ff1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:53.699866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c0f1-1bbd-44ad-acee-2eec7a2f9ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:53.699866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c0f1-1bbd-44ad-acee-2eec7a2f9ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:53.769373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9047c0f1-1bbd-44ad-acee-2eec7a2f9ff1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:53.771555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9047c0f1-1bbd-44ad-acee-2eec7a2f9ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:53.901340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbabfbd-f1a0-4234-97d4-6f5a0786bba9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:53.901705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbabfbd-f1a0-4234-97d4-6f5a0786bba9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:53.901903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbabfbd-f1a0-4234-97d4-6f5a0786bba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:53.957275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6dbabfbd-f1a0-4234-97d4-6f5a0786bba9 None None] MFA Rules not processed for user `0c65277d89a24081a47a7f928f6c6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:53.959391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6dbabfbd-f1a0-4234-97d4-6f5a0786bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:54.009625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 892/1774] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:54.017035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848e6fb-3674-4d1b-ac5f-a21a7d4b1970 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:54.017323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848e6fb-3674-4d1b-ac5f-a21a7d4b1970 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:54.017621 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848e6fb-3674-4d1b-ac5f-a21a7d4b1970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:54.074274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c848e6fb-3674-4d1b-ac5f-a21a7d4b1970 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:54.075549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c848e6fb-3674-4d1b-ac5f-a21a7d4b1970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:54.105290 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 893/1775] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:49:54.109504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848e6fb-3674-4d1b-ac5f-a21a7d4b1970 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:54.126948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848e6fb-3674-4d1b-ac5f-a21a7d4b1970 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:54.136220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002247d-782a-4f33-8c65-baf7d6a30245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:54.137098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002247d-782a-4f33-8c65-baf7d6a30245 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:54.137531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002247d-782a-4f33-8c65-baf7d6a30245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:54.137959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002247d-782a-4f33-8c65-baf7d6a30245 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:54.139207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002247d-782a-4f33-8c65-baf7d6a30245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:54.139652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002247d-782a-4f33-8c65-baf7d6a30245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:54.150727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002247d-782a-4f33-8c65-baf7d6a30245 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:54.160911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 883/1776] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Jul 27 07:49:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:54.174060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:54.194443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 894/1777] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:49:54.198704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbabfbd-f1a0-4234-97d4-6f5a0786bba9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:54.225363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbabfbd-f1a0-4234-97d4-6f5a0786bba9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:54.230856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377385a-5300-4688-9478-ad26d1b7caf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:54.238302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377385a-5300-4688-9478-ad26d1b7caf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:54.238580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377385a-5300-4688-9478-ad26d1b7caf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:54.238900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377385a-5300-4688-9478-ad26d1b7caf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:54.239618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377385a-5300-4688-9478-ad26d1b7caf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:54.241966 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377385a-5300-4688-9478-ad26d1b7caf6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:54.315618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 884/1778] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:54 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:54.316272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002247d-782a-4f33-8c65-baf7d6a30245 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:54.349856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002247d-782a-4f33-8c65-baf7d6a30245 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:54.514021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377385a-5300-4688-9478-ad26d1b7caf6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:54.516341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3377385a-5300-4688-9478-ad26d1b7caf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:54.572429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187aa4-6128-4300-aa69-1ab4ea40838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:54.573014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187aa4-6128-4300-aa69-1ab4ea40838a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:54.573300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187aa4-6128-4300-aa69-1ab4ea40838a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:54.573577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187aa4-6128-4300-aa69-1ab4ea40838a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:54.574273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64187aa4-6128-4300-aa69-1ab4ea40838a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:54.579894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64187aa4-6128-4300-aa69-1ab4ea40838a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:54.642662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 895/1779] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:54 2022] POST /identity/v3/users => generated 300 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:49:54.644572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187aa4-6128-4300-aa69-1ab4ea40838a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:54.666921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187aa4-6128-4300-aa69-1ab4ea40838a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:54.676127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377385a-5300-4688-9478-ad26d1b7caf6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:54.680433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b39dd8-b0d5-4eb5-ae41-02d5262aa4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:54.681083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b39dd8-b0d5-4eb5-ae41-02d5262aa4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:54.681854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b39dd8-b0d5-4eb5-ae41-02d5262aa4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:54.682113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b39dd8-b0d5-4eb5-ae41-02d5262aa4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:54.682834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b39dd8-b0d5-4eb5-ae41-02d5262aa4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:54.684511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b39dd8-b0d5-4eb5-ae41-02d5262aa4cf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:54.716413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba697359-6f2f-4785-80c8-bddf468e25ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:54.717490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba697359-6f2f-4785-80c8-bddf468e25ac service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:54.717920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba697359-6f2f-4785-80c8-bddf468e25ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:54.719154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba697359-6f2f-4785-80c8-bddf468e25ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:54.731386 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 896/1780] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:54.738738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b39dd8-b0d5-4eb5-ae41-02d5262aa4cf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:54.751769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba697359-6f2f-4785-80c8-bddf468e25ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:54.753559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba697359-6f2f-4785-80c8-bddf468e25ac service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:54.756717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b39dd8-b0d5-4eb5-ae41-02d5262aa4cf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:54.772689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96100b63-82e0-4cdb-879e-e104e6289374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:54.778021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96100b63-82e0-4cdb-879e-e104e6289374 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:54.780478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96100b63-82e0-4cdb-879e-e104e6289374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:54.784189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96100b63-82e0-4cdb-879e-e104e6289374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:54.786547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 885/1781] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:54.787302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96100b63-82e0-4cdb-879e-e104e6289374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:54.803302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96100b63-82e0-4cdb-879e-e104e6289374 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:54.832736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 897/1782] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:54.836759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba697359-6f2f-4785-80c8-bddf468e25ac service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:54.864885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba697359-6f2f-4785-80c8-bddf468e25ac service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:54.879506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ba1be-22aa-4c19-9349-a99fedc7ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:54.880447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba1be-22aa-4c19-9349-a99fedc7ab3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:54.881851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba1be-22aa-4c19-9349-a99fedc7ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:54.882330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba1be-22aa-4c19-9349-a99fedc7ab3e admin admin] PATH_INFO: `/v3/projects/d7931ae0b5ca4574a09052e09a8136b6/users/e36c44696a0e4988b6a316baa8f8ff02/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:54.938812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba1be-22aa-4c19-9349-a99fedc7ab3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7931ae0b5ca4574a09052e09a8136b6, user_id=e36c44696a0e4988b6a316baa8f8ff02, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:54.944902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba1be-22aa-4c19-9349-a99fedc7ab3e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:54.974819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96100b63-82e0-4cdb-879e-e104e6289374 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:54.976983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-96100b63-82e0-4cdb-879e-e104e6289374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:54.998359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 886/1783] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:54 2022] PUT /identity/v3/projects/d7931ae0b5ca4574a09052e09a8136b6/users/e36c44696a0e4988b6a316baa8f8ff02/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:55.013363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d7cc6-cf8e-4418-ae9a-86ee3da9808c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:55.013633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d7cc6-cf8e-4418-ae9a-86ee3da9808c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:55.013914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d7cc6-cf8e-4418-ae9a-86ee3da9808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:55.021101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96100b63-82e0-4cdb-879e-e104e6289374 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:55.107707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-578d7cc6-cf8e-4418-ae9a-86ee3da9808c None None] MFA Rules not processed for user `e36c44696a0e4988b6a316baa8f8ff02`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:55.109212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-578d7cc6-cf8e-4418-ae9a-86ee3da9808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:55.215093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:55.233421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:55.234219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:55.240114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:55.240603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] PATH_INFO: `/v3/projects/364f8aeb05634e389dfdabc209faf7b9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:55.243875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364f8aeb05634e389dfdabc209faf7b9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:55.245959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:55.313802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 887/1784] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:55.314767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d7cc6-cf8e-4418-ae9a-86ee3da9808c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:55.359608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d7cc6-cf8e-4418-ae9a-86ee3da9808c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:55.367976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99d2d1-6e21-4db5-a839-491c42d71e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:55.369547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99d2d1-6e21-4db5-a839-491c42d71e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:55.369834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99d2d1-6e21-4db5-a839-491c42d71e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:55.370108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99d2d1-6e21-4db5-a839-491c42d71e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:55.370801 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99d2d1-6e21-4db5-a839-491c42d71e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:55.378380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99d2d1-6e21-4db5-a839-491c42d71e20 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:55.433126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364f8aeb05634e389dfdabc209faf7b9', 'request_id': 'req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:55.458094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364f8aeb05634e389dfdabc209faf7b9', 'request_id': 'req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:55.484232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364f8aeb05634e389dfdabc209faf7b9', 'request_id': 'req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:55.491748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:55.511246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 888/1785] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:55 2022] POST /identity/v3/projects => generated 401 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:55.512375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99d2d1-6e21-4db5-a839-491c42d71e20 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:55.528213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] The token cache is being invalidate because project 364f8aeb05634e389dfdabc209faf7b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:55.528518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:55.537223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:55.546356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 898/1786] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:54 2022] DELETE /identity/v3/projects/364f8aeb05634e389dfdabc209faf7b9 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:55.547846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:55.556037 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:55.747292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99d2d1-6e21-4db5-a839-491c42d71e20 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:55.770060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6351-ebc0-4c52-9140-b8c487f282ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:55.771318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6351-ebc0-4c52-9140-b8c487f282ef admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:55.771595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6351-ebc0-4c52-9140-b8c487f282ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:55.771863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6351-ebc0-4c52-9140-b8c487f282ef admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:55.772550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6351-ebc0-4c52-9140-b8c487f282ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:55.774506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6351-ebc0-4c52-9140-b8c487f282ef admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:55.780864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3610747-79dd-4fd4-a4cf-b7cd1ed9e2d7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:55.809180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:55.810475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:55.811099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:55.811624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] PATH_INFO: `/v3/users/9df296e8ed4642c9a6c7e8c31a32f55b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:55.814454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df296e8ed4642c9a6c7e8c31a32f55b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:55.819491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:55.827764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 889/1787] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:55 2022] POST /identity/v3/users => generated 307 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:55.828925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6351-ebc0-4c52-9140-b8c487f282ef admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:55.838143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1c2e6351-ebc0-4c52-9140-b8c487f282ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:55.870319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6351-ebc0-4c52-9140-b8c487f282ef admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:55.882122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1293c4-659e-4dff-b335-527c7b6351ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:55.882843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1293c4-659e-4dff-b335-527c7b6351ab admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:55.884015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1293c4-659e-4dff-b335-527c7b6351ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:55.884313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1293c4-659e-4dff-b335-527c7b6351ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:55.886588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1293c4-659e-4dff-b335-527c7b6351ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:55.888424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1293c4-659e-4dff-b335-527c7b6351ab admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:55.925812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 890/1788] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:55.931974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1293c4-659e-4dff-b335-527c7b6351ab admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:55.967891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df296e8ed4642c9a6c7e8c31a32f55b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:55.973271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1293c4-659e-4dff-b335-527c7b6351ab admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:55.989997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df296e8ed4642c9a6c7e8c31a32f55b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:55.993221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0308d-71b5-4f61-902a-e3af9085f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:55.996182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0308d-71b5-4f61-902a-e3af9085f12c admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:55.996467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0308d-71b5-4f61-902a-e3af9085f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:55.996783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0308d-71b5-4f61-902a-e3af9085f12c admin admin] PATH_INFO: `/v3/projects/fc5b00a7688e43b4988d3e46569815d3/users/14d035143b614ce7a445d1d8b125f78b/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:56.026086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df296e8ed4642c9a6c7e8c31a32f55b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:56.026976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df296e8ed4642c9a6c7e8c31a32f55b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:56.042787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0308d-71b5-4f61-902a-e3af9085f12c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5b00a7688e43b4988d3e46569815d3, user_id=14d035143b614ce7a445d1d8b125f78b, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:56.048699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0308d-71b5-4f61-902a-e3af9085f12c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:56.050159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df296e8ed4642c9a6c7e8c31a32f55b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:56.068099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 899/1789] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:49:55 2022] DELETE /identity/v3/users/9df296e8ed4642c9a6c7e8c31a32f55b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:56.086797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 891/1790] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:55 2022] PUT /identity/v3/projects/fc5b00a7688e43b4988d3e46569815d3/users/14d035143b614ce7a445d1d8b125f78b/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:56.087966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:56.090552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:56.286386 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bb265-eb6c-4855-bdef-2f0c7c37827c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:56.374261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:56.516825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abeead-a936-4957-a716-22a3c86819db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:56.517478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abeead-a936-4957-a716-22a3c86819db admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:56.517762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abeead-a936-4957-a716-22a3c86819db admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:56.518045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abeead-a936-4957-a716-22a3c86819db admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:56.518777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abeead-a936-4957-a716-22a3c86819db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:56.520552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abeead-a936-4957-a716-22a3c86819db admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:56.589199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 900/1791] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:49:56.593929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0308d-71b5-4f61-902a-e3af9085f12c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:56.614290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0308d-71b5-4f61-902a-e3af9085f12c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:56.635248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6819c-851c-4a5d-854e-0df13cc433c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:56.636030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6819c-851c-4a5d-854e-0df13cc433c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:56.636387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6819c-851c-4a5d-854e-0df13cc433c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:56.636666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6819c-851c-4a5d-854e-0df13cc433c4 admin admin] PATH_INFO: `/v3/projects/fc5b00a7688e43b4988d3e46569815d3/users/14d035143b614ce7a445d1d8b125f78b/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:56.641214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6819c-851c-4a5d-854e-0df13cc433c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5b00a7688e43b4988d3e46569815d3, user_id=14d035143b614ce7a445d1d8b125f78b, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:56.643999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6819c-851c-4a5d-854e-0df13cc433c4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:56.680564 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 892/1792] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:56 2022] PUT /identity/v3/projects/fc5b00a7688e43b4988d3e46569815d3/users/14d035143b614ce7a445d1d8b125f78b/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:49:56.701328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150baa-a283-47a0-8bcd-9efe22f7bed4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:56.701907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150baa-a283-47a0-8bcd-9efe22f7bed4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:56.702419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150baa-a283-47a0-8bcd-9efe22f7bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:56.818462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e8150baa-a283-47a0-8bcd-9efe22f7bed4 None None] MFA Rules not processed for user `14d035143b614ce7a445d1d8b125f78b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:56.820617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e8150baa-a283-47a0-8bcd-9efe22f7bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:57.068180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 901/1793] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:57.100307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6819c-851c-4a5d-854e-0df13cc433c4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:57.103035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-63f6819c-851c-4a5d-854e-0df13cc433c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:57.364593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6819c-851c-4a5d-854e-0df13cc433c4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:57.374453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71855d04-7979-4648-bf04-237d34a3afe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:57.375162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71855d04-7979-4648-bf04-237d34a3afe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:57.375426 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71855d04-7979-4648-bf04-237d34a3afe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:57.375704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71855d04-7979-4648-bf04-237d34a3afe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:57.406733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:57.423644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71855d04-7979-4648-bf04-237d34a3afe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:57.425167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71855d04-7979-4648-bf04-237d34a3afe9 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:57.448323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 893/1794] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:57.503595 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8150baa-a283-47a0-8bcd-9efe22f7bed4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:57.505932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e8150baa-a283-47a0-8bcd-9efe22f7bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:57.636771 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71855d04-7979-4648-bf04-237d34a3afe9 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:57.655350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71855d04-7979-4648-bf04-237d34a3afe9 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:57.664626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bdcf1-b2f6-4dcf-8a1f-c4af5b9e175c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:57.666838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bdcf1-b2f6-4dcf-8a1f-c4af5b9e175c service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:57.667153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bdcf1-b2f6-4dcf-8a1f-c4af5b9e175c service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:57.667435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bdcf1-b2f6-4dcf-8a1f-c4af5b9e175c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:57.674327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a25bdcf1-b2f6-4dcf-8a1f-c4af5b9e175c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:57.716284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8150baa-a283-47a0-8bcd-9efe22f7bed4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:57.729591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:57.730307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:57.730593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:57.730876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] PATH_INFO: `/v3/projects/e3a4d89c612e48df81828affc081a157` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:57.738315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a4d89c612e48df81828affc081a157)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:57.743637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:57.892710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bdcf1-b2f6-4dcf-8a1f-c4af5b9e175c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:57.894202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bdcf1-b2f6-4dcf-8a1f-c4af5b9e175c service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:57.922653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:57.984565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 894/1795] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:49:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:49:57.986610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a4d89c612e48df81828affc081a157', 'request_id': 'req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:58.009353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a4d89c612e48df81828affc081a157', 'request_id': 'req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:58.020509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a4d89c612e48df81828affc081a157', 'request_id': 'req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:58.073043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] The token cache is being invalidate because project e3a4d89c612e48df81828affc081a157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:49:58.073452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:58.075348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b66dfe28-5767-4cc7-b8f6-73514f4c7a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:49:58.083190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 902/1796] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:57 2022] DELETE /identity/v3/projects/e3a4d89c612e48df81828affc081a157 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:58.088978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad17e7a-71da-4361-9232-5bf139409b85 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:58.089387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad17e7a-71da-4361-9232-5bf139409b85 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:58.089561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad17e7a-71da-4361-9232-5bf139409b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:58.157545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5ad17e7a-71da-4361-9232-5bf139409b85 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:58.163207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5ad17e7a-71da-4361-9232-5bf139409b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:58.363261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a421-612b-48e2-a914-fabd8bd72939 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:58.363547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a421-612b-48e2-a914-fabd8bd72939 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:58.364345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a421-612b-48e2-a914-fabd8bd72939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:58.366898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 895/1797] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:58.434922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7b90a421-612b-48e2-a914-fabd8bd72939 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:58.436496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7b90a421-612b-48e2-a914-fabd8bd72939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:58.471375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 903/1798] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:58.476209 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad17e7a-71da-4361-9232-5bf139409b85 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:58.505836 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad17e7a-71da-4361-9232-5bf139409b85 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:58.525563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac769729-3de0-495d-8222-7b0e2c4ed9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:58.526219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac769729-3de0-495d-8222-7b0e2c4ed9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:58.526495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac769729-3de0-495d-8222-7b0e2c4ed9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:58.526772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac769729-3de0-495d-8222-7b0e2c4ed9f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:58.528207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac769729-3de0-495d-8222-7b0e2c4ed9f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:49:58.528207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac769729-3de0-495d-8222-7b0e2c4ed9f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:58.540306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac769729-3de0-495d-8222-7b0e2c4ed9f5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:58.610571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 896/1799] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:49:58.614390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a421-612b-48e2-a914-fabd8bd72939 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:58.624431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a421-612b-48e2-a914-fabd8bd72939 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:58.672013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1c20e-34a4-4376-9126-aade6315cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:58.673520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1c20e-34a4-4376-9126-aade6315cd67 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:58.674011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1c20e-34a4-4376-9126-aade6315cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:58.674455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1c20e-34a4-4376-9126-aade6315cd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:58.675485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1c20e-34a4-4376-9126-aade6315cd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:58.686308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1c20e-34a4-4376-9126-aade6315cd67 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:58.829800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 904/1800] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:58 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:58.831087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac769729-3de0-495d-8222-7b0e2c4ed9f5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:58.861182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac769729-3de0-495d-8222-7b0e2c4ed9f5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:59.036639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f899c5-846f-47cc-b2e5-027047cee87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:59.037306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f899c5-846f-47cc-b2e5-027047cee87e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:59.037592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f899c5-846f-47cc-b2e5-027047cee87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:59.037869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f899c5-846f-47cc-b2e5-027047cee87e admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:59.038561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f899c5-846f-47cc-b2e5-027047cee87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:59.045985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f899c5-846f-47cc-b2e5-027047cee87e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:59.111844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1c20e-34a4-4376-9126-aade6315cd67 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:59.118611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 897/1801] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:58 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:59.163485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1c20e-34a4-4376-9126-aade6315cd67 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:59.186203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7934b-1e1b-4f23-8f9c-661954194a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:59.186846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7934b-1e1b-4f23-8f9c-661954194a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:59.187450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7934b-1e1b-4f23-8f9c-661954194a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:59.187884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7934b-1e1b-4f23-8f9c-661954194a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:59.189537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7934b-1e1b-4f23-8f9c-661954194a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:59.191515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7934b-1e1b-4f23-8f9c-661954194a97 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:59.240953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 905/1802] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:59.241750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f899c5-846f-47cc-b2e5-027047cee87e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:59.255852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f899c5-846f-47cc-b2e5-027047cee87e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:59.279706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb4f7a-78d3-4d45-9abf-6019b7182d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:59.280744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb4f7a-78d3-4d45-9abf-6019b7182d76 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:59.281214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb4f7a-78d3-4d45-9abf-6019b7182d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:59.281683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb4f7a-78d3-4d45-9abf-6019b7182d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:59.282565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb4f7a-78d3-4d45-9abf-6019b7182d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:59.284419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb4f7a-78d3-4d45-9abf-6019b7182d76 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:59.289489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:59.319791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7934b-1e1b-4f23-8f9c-661954194a97 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:59.320084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 898/1803] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:49:59.337182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7934b-1e1b-4f23-8f9c-661954194a97 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:59.355629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc588ca3-87a2-48c5-8d79-0ed5468d6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:59.356343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc588ca3-87a2-48c5-8d79-0ed5468d6530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:59.356619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc588ca3-87a2-48c5-8d79-0ed5468d6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:59.356897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc588ca3-87a2-48c5-8d79-0ed5468d6530 admin admin] PATH_INFO: `/v3/projects/de92aa7d97e44b3a847fa74db90c8f58/users/44ce284e0f124104a9ffc104d7b573ce/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:59.440242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc588ca3-87a2-48c5-8d79-0ed5468d6530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de92aa7d97e44b3a847fa74db90c8f58, user_id=44ce284e0f124104a9ffc104d7b573ce, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:59.446232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc588ca3-87a2-48c5-8d79-0ed5468d6530 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:59.492712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 906/1804] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:49:59 2022] PUT /identity/v3/projects/de92aa7d97e44b3a847fa74db90c8f58/users/44ce284e0f124104a9ffc104d7b573ce/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:49:59.503598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b64d0f-ccc4-4523-a8fe-5c86273fd487 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:59.503881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b64d0f-ccc4-4523-a8fe-5c86273fd487 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:59.505911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b64d0f-ccc4-4523-a8fe-5c86273fd487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:59.582706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b0b64d0f-ccc4-4523-a8fe-5c86273fd487 None None] MFA Rules not processed for user `44ce284e0f124104a9ffc104d7b573ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:49:59.584293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b0b64d0f-ccc4-4523-a8fe-5c86273fd487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:49:59.684902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 899/1805] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:49:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:49:59.689307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc588ca3-87a2-48c5-8d79-0ed5468d6530 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:59.824553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc588ca3-87a2-48c5-8d79-0ed5468d6530 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:59.833610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafecc7-cca3-4946-87b1-45807557de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:49:59.842782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafecc7-cca3-4946-87b1-45807557de0f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:49:59.843557 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafecc7-cca3-4946-87b1-45807557de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:49:59.844113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafecc7-cca3-4946-87b1-45807557de0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:49:59.845180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafecc7-cca3-4946-87b1-45807557de0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:49:59.847912 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafecc7-cca3-4946-87b1-45807557de0f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:49:59.915331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 907/1806] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:49:59 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:49:59.919545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b64d0f-ccc4-4523-a8fe-5c86273fd487 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:59.963004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b64d0f-ccc4-4523-a8fe-5c86273fd487 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:49:59.977052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafecc7-cca3-4946-87b1-45807557de0f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:49:59.979114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8fafecc7-cca3-4946-87b1-45807557de0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:00.284356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bc173-39aa-493b-b0ec-2c71d22da1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:00.286464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc173-39aa-493b-b0ec-2c71d22da1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:00.287154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:00.288460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc173-39aa-493b-b0ec-2c71d22da1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:00.289518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc173-39aa-493b-b0ec-2c71d22da1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:00.295197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bc173-39aa-493b-b0ec-2c71d22da1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:00.298939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bc173-39aa-493b-b0ec-2c71d22da1a5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:00.311005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafecc7-cca3-4946-87b1-45807557de0f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:00.328840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:00.329531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:00.334053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:00.334385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] PATH_INFO: `/v3/projects/175de7ec70b04aa297141b58d3e0f69b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:00.340806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=175de7ec70b04aa297141b58d3e0f69b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:00.347245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:00.417006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 900/1807] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:49:59 2022] POST /identity/v3/users => generated 300 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:00.419206 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce523d9-44d1-426e-aeea-e917de32ee5e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:00.424565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce523d9-44d1-426e-aeea-e917de32ee5e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:00.425409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce523d9-44d1-426e-aeea-e917de32ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:00.495307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fce523d9-44d1-426e-aeea-e917de32ee5e None None] MFA Rules not processed for user `eb3d3ca2457b47a29b7c94bd8be450cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:00.496608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fce523d9-44d1-426e-aeea-e917de32ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:00.550399 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175de7ec70b04aa297141b58d3e0f69b', 'request_id': 'req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:00.569422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175de7ec70b04aa297141b58d3e0f69b', 'request_id': 'req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:00.585284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175de7ec70b04aa297141b58d3e0f69b', 'request_id': 'req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:00.636265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] The token cache is being invalidate because project 175de7ec70b04aa297141b58d3e0f69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:00.638986 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:00.640390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:00.646917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 908/1808] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:49:59 2022] DELETE /identity/v3/projects/175de7ec70b04aa297141b58d3e0f69b => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:00.648148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:00.652095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:00.728456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 901/1809] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:00.737268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3eb2c-341b-41b0-ba41-6e0e232daf6d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:00.737268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3eb2c-341b-41b0-ba41-6e0e232daf6d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:00.737268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3eb2c-341b-41b0-ba41-6e0e232daf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:00.800152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-69b3eb2c-341b-41b0-ba41-6e0e232daf6d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:00.801576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-69b3eb2c-341b-41b0-ba41-6e0e232daf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:00.885469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:00.925580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d28d8-020f-40f5-8fad-c21dc87e9d7b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:00.940180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d261b03-a321-4e55-8001-95151df3f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:00.940878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d261b03-a321-4e55-8001-95151df3f931 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:00.943529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d261b03-a321-4e55-8001-95151df3f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:00.944101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d261b03-a321-4e55-8001-95151df3f931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:00.948467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d261b03-a321-4e55-8001-95151df3f931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:00.956482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d261b03-a321-4e55-8001-95151df3f931 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:00.980352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 902/1810] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:00.988890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 909/1811] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:00.991259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d261b03-a321-4e55-8001-95151df3f931 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:00.991941 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b77f2-6771-4d59-bbce-ebca3e72d682 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:00.992390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b77f2-6771-4d59-bbce-ebca3e72d682 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:00.998448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b77f2-6771-4d59-bbce-ebca3e72d682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:01.016070 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d261b03-a321-4e55-8001-95151df3f931 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:01.028900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cc4b77f2-6771-4d59-bbce-ebca3e72d682 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:01.030439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cc4b77f2-6771-4d59-bbce-ebca3e72d682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:01.040984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aca75d-344d-40b3-ba8f-65f2522ae895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:01.042791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aca75d-344d-40b3-ba8f-65f2522ae895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:01.052304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aca75d-344d-40b3-ba8f-65f2522ae895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:01.052304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aca75d-344d-40b3-ba8f-65f2522ae895 admin admin] PATH_INFO: `/v3/projects/6059bff2ee594c86abdc8db5a4a06d5c/users/8e3b75f4cb77455ca5e7317aa4ce1415/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:01.055570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 903/1812] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:01.057112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab315c4-fa6f-47ae-815f-b5813bb9c5c9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:01.057600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab315c4-fa6f-47ae-815f-b5813bb9c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:01.058013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab315c4-fa6f-47ae-815f-b5813bb9c5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:01.108074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aca75d-344d-40b3-ba8f-65f2522ae895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6059bff2ee594c86abdc8db5a4a06d5c, user_id=8e3b75f4cb77455ca5e7317aa4ce1415, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:01.117063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aca75d-344d-40b3-ba8f-65f2522ae895 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:01.117379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5ab315c4-fa6f-47ae-815f-b5813bb9c5c9 None None] MFA Rules not processed for user `df8fb928aa42413b9d03e83f46dd48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:01.118760 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5ab315c4-fa6f-47ae-815f-b5813bb9c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:01.159160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 910/1813] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:00 2022] PUT /identity/v3/projects/6059bff2ee594c86abdc8db5a4a06d5c/users/8e3b75f4cb77455ca5e7317aa4ce1415/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:01.161562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aca75d-344d-40b3-ba8f-65f2522ae895 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:01.257768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 904/1814] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:01.268762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab315c4-fa6f-47ae-815f-b5813bb9c5c9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:01.281021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab315c4-fa6f-47ae-815f-b5813bb9c5c9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:01.359811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feb7ed-1e69-477d-93e4-1300b6349f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:01.360564 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feb7ed-1e69-477d-93e4-1300b6349f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:01.360916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feb7ed-1e69-477d-93e4-1300b6349f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:01.361261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feb7ed-1e69-477d-93e4-1300b6349f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:01.362048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9feb7ed-1e69-477d-93e4-1300b6349f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:01.364490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9feb7ed-1e69-477d-93e4-1300b6349f73 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:01.375639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 905/1815] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:01.383889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feb7ed-1e69-477d-93e4-1300b6349f73 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:01.396756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feb7ed-1e69-477d-93e4-1300b6349f73 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:01.400350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:01.411438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a1e35-6a81-4d6d-adc7-a08441bd59f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:01.412222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a1e35-6a81-4d6d-adc7-a08441bd59f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:01.412504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a1e35-6a81-4d6d-adc7-a08441bd59f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:01.412836 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a1e35-6a81-4d6d-adc7-a08441bd59f4 admin admin] PATH_INFO: `/v3/projects/6059bff2ee594c86abdc8db5a4a06d5c/users/8e3b75f4cb77455ca5e7317aa4ce1415/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:01.413939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aca75d-344d-40b3-ba8f-65f2522ae895 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:01.416712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a1e35-6a81-4d6d-adc7-a08441bd59f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6059bff2ee594c86abdc8db5a4a06d5c, user_id=8e3b75f4cb77455ca5e7317aa4ce1415, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:01.424392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a1e35-6a81-4d6d-adc7-a08441bd59f4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:01.436137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbfdbf-fe63-48b1-b134-874470a6a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:01.436499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbfdbf-fe63-48b1-b134-874470a6a924 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:01.437006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbfdbf-fe63-48b1-b134-874470a6a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:01.437128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbfdbf-fe63-48b1-b134-874470a6a924 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:01.437753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbfdbf-fe63-48b1-b134-874470a6a924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:01.438056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbfdbf-fe63-48b1-b134-874470a6a924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:01.444321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbfdbf-fe63-48b1-b134-874470a6a924 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:01.469633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 906/1816] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:01 2022] PUT /identity/v3/projects/6059bff2ee594c86abdc8db5a4a06d5c/users/8e3b75f4cb77455ca5e7317aa4ce1415/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:01.486932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 911/1817] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:50:01.487166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08add7f-985d-4a17-853e-94e6f7bf5f4f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:01.487166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08add7f-985d-4a17-853e-94e6f7bf5f4f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:01.487166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08add7f-985d-4a17-853e-94e6f7bf5f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:01.491700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbfdbf-fe63-48b1-b134-874470a6a924 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:01.513406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbfdbf-fe63-48b1-b134-874470a6a924 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:01.563559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a08add7f-985d-4a17-853e-94e6f7bf5f4f None None] MFA Rules not processed for user `8e3b75f4cb77455ca5e7317aa4ce1415`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:01.566479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a08add7f-985d-4a17-853e-94e6f7bf5f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:01.658175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:01.714384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c13d4-37cc-4a85-8a88-10618eb88a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:01.719853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c13d4-37cc-4a85-8a88-10618eb88a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:01.719853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c13d4-37cc-4a85-8a88-10618eb88a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:01.719853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c13d4-37cc-4a85-8a88-10618eb88a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:01.726327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c13d4-37cc-4a85-8a88-10618eb88a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:01.729307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c13d4-37cc-4a85-8a88-10618eb88a67 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:01.782961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 907/1818] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:01.797233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08add7f-985d-4a17-853e-94e6f7bf5f4f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:01.799116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a08add7f-985d-4a17-853e-94e6f7bf5f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:01.822903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 912/1819] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:01 2022] POST /identity/v3/projects => generated 365 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:01.827896 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c13d4-37cc-4a85-8a88-10618eb88a67 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:01.920200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08add7f-985d-4a17-853e-94e6f7bf5f4f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:01.960615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c13d4-37cc-4a85-8a88-10618eb88a67 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:01.967226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511b7c-44a1-4a84-b43d-d0c7fe4d9fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:01.968761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511b7c-44a1-4a84-b43d-d0c7fe4d9fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:01.969045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511b7c-44a1-4a84-b43d-d0c7fe4d9fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:01.969317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511b7c-44a1-4a84-b43d-d0c7fe4d9fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:01.970104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511b7c-44a1-4a84-b43d-d0c7fe4d9fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:02.010727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511b7c-44a1-4a84-b43d-d0c7fe4d9fc2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:02.125052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 913/1820] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:01 2022] POST /identity/v3/users => generated 283 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:02.132978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511b7c-44a1-4a84-b43d-d0c7fe4d9fc2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:02.165385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fa0a7-0a4f-4957-b10b-a82638b0b871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:02.167740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fa0a7-0a4f-4957-b10b-a82638b0b871 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:02.169441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fa0a7-0a4f-4957-b10b-a82638b0b871 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:02.170282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fa0a7-0a4f-4957-b10b-a82638b0b871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:02.214222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511b7c-44a1-4a84-b43d-d0c7fe4d9fc2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:02.249113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b983a-259f-4dc8-ada5-55e69e681726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:02.250814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b983a-259f-4dc8-ada5-55e69e681726 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:02.253379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b983a-259f-4dc8-ada5-55e69e681726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:02.254273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b983a-259f-4dc8-ada5-55e69e681726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:02.256737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b983a-259f-4dc8-ada5-55e69e681726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:02.279389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b983a-259f-4dc8-ada5-55e69e681726 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:02.329313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 914/1821] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:02.341992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b983a-259f-4dc8-ada5-55e69e681726 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:02.372361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b983a-259f-4dc8-ada5-55e69e681726 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:02.393485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6e744-711c-4584-8e3f-e0cca04e8cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:02.394132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6e744-711c-4584-8e3f-e0cca04e8cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:02.394464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6e744-711c-4584-8e3f-e0cca04e8cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:02.395575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6e744-711c-4584-8e3f-e0cca04e8cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:02.396337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6e744-711c-4584-8e3f-e0cca04e8cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:02.397994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6e744-711c-4584-8e3f-e0cca04e8cdd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:02.443158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 915/1822] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:02.448899 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6e744-711c-4584-8e3f-e0cca04e8cdd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:02.475024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fa0a7-0a4f-4957-b10b-a82638b0b871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:02.476616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fa0a7-0a4f-4957-b10b-a82638b0b871 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:02.478098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6e744-711c-4584-8e3f-e0cca04e8cdd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:02.500686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c8897-af43-481b-a75b-06d0d78b18bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:02.501662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8897-af43-481b-a75b-06d0d78b18bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:02.502091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8897-af43-481b-a75b-06d0d78b18bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:02.502525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8897-af43-481b-a75b-06d0d78b18bb admin admin] PATH_INFO: `/v3/projects/e32e36d9b13342ca8fc5a12917187c63/users/2991762f970d41f08307804862d2e035/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:02.530345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 908/1823] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:02.552593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c8897-af43-481b-a75b-06d0d78b18bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32e36d9b13342ca8fc5a12917187c63, user_id=2991762f970d41f08307804862d2e035, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:02.555502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c8897-af43-481b-a75b-06d0d78b18bb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:02.588648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 916/1824] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:02 2022] PUT /identity/v3/projects/e32e36d9b13342ca8fc5a12917187c63/users/2991762f970d41f08307804862d2e035/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:02.603424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1375e7-7716-4551-a160-c4597f864ad5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:02.603424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1375e7-7716-4551-a160-c4597f864ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:02.603999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1375e7-7716-4551-a160-c4597f864ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:02.744533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3d1375e7-7716-4551-a160-c4597f864ad5 None None] MFA Rules not processed for user `2991762f970d41f08307804862d2e035`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:02.746464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3d1375e7-7716-4551-a160-c4597f864ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:02.839483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:03.027909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c8897-af43-481b-a75b-06d0d78b18bb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:03.028100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 909/1825] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:03.086163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:03.283601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c8897-af43-481b-a75b-06d0d78b18bb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:03.304031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55da61-23ab-4dc1-8451-c655d50cfa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:03.304700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55da61-23ab-4dc1-8451-c655d50cfa05 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:03.305023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55da61-23ab-4dc1-8451-c655d50cfa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:03.305238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55da61-23ab-4dc1-8451-c655d50cfa05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:03.308993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55da61-23ab-4dc1-8451-c655d50cfa05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:03.319071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55da61-23ab-4dc1-8451-c655d50cfa05 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:03.427948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 917/1826] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:03 2022] POST /identity/v3/projects => generated 365 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:03.435524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1375e7-7716-4551-a160-c4597f864ad5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:03.439440 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb1ca-e3a7-414f-84ca-e458a26118a5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:03.439729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb1ca-e3a7-414f-84ca-e458a26118a5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:03.440013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb1ca-e3a7-414f-84ca-e458a26118a5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:03.442426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 918/1827] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 07:50:03.461223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1375e7-7716-4551-a160-c4597f864ad5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:03.808413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83b63c-5ad3-48b1-811a-22480d9a568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:03.809090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83b63c-5ad3-48b1-811a-22480d9a568d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:03.828592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83b63c-5ad3-48b1-811a-22480d9a568d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:03.829235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83b63c-5ad3-48b1-811a-22480d9a568d admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:03.829986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83b63c-5ad3-48b1-811a-22480d9a568d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:03.838329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83b63c-5ad3-48b1-811a-22480d9a568d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:03.991465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0afcc-9e84-4ad7-b286-d5287047124e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:03.992029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0afcc-9e84-4ad7-b286-d5287047124e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:03.992291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0afcc-9e84-4ad7-b286-d5287047124e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:04.006236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 910/1828] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:03 2022] POST /identity/v3/users => generated 289 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:04.012014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83b63c-5ad3-48b1-811a-22480d9a568d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:04.053717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83b63c-5ad3-48b1-811a-22480d9a568d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:04.078405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f30c7-1eb8-48c5-b6f8-69e4d5d0a78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:04.082041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f30c7-1eb8-48c5-b6f8-69e4d5d0a78f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:04.088322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f30c7-1eb8-48c5-b6f8-69e4d5d0a78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:04.088714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f30c7-1eb8-48c5-b6f8-69e4d5d0a78f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:04.089702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f30c7-1eb8-48c5-b6f8-69e4d5d0a78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:04.094858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f30c7-1eb8-48c5-b6f8-69e4d5d0a78f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:04.100106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f2d0afcc-9e84-4ad7-b286-d5287047124e None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:04.119033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f2d0afcc-9e84-4ad7-b286-d5287047124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:04.147361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 911/1829] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:04.152040 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f30c7-1eb8-48c5-b6f8-69e4d5d0a78f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:04.203106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f30c7-1eb8-48c5-b6f8-69e4d5d0a78f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:04.228736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c22dc8-e01c-48f6-aa1c-79643686d98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:04.230367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c22dc8-e01c-48f6-aa1c-79643686d98b admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:04.231958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c22dc8-e01c-48f6-aa1c-79643686d98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:04.233791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c22dc8-e01c-48f6-aa1c-79643686d98b admin admin] PATH_INFO: `/v3/projects/457a7381083e4ded9ec49305c290df4d/users/9d6ec21287f94c3abbbaf358edd37b49/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:04.312291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c22dc8-e01c-48f6-aa1c-79643686d98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=457a7381083e4ded9ec49305c290df4d, user_id=9d6ec21287f94c3abbbaf358edd37b49, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:04.324890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c22dc8-e01c-48f6-aa1c-79643686d98b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:04.373148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 912/1830] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:04 2022] PUT /identity/v3/projects/457a7381083e4ded9ec49305c290df4d/users/9d6ec21287f94c3abbbaf358edd37b49/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:04.378456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c22dc8-e01c-48f6-aa1c-79643686d98b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:04.541253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 919/1831] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:50:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:04.543236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0afcc-9e84-4ad7-b286-d5287047124e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:04.548441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f2d0afcc-9e84-4ad7-b286-d5287047124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:04.603958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c22dc8-e01c-48f6-aa1c-79643686d98b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:04.605473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0afcc-9e84-4ad7-b286-d5287047124e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:04.624561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1800e-fde4-4196-bef3-6142148156ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:04.625217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1800e-fde4-4196-bef3-6142148156ae admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:04.625829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1800e-fde4-4196-bef3-6142148156ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:04.626128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1800e-fde4-4196-bef3-6142148156ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:04.631660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1800e-fde4-4196-bef3-6142148156ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:04.634931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1800e-fde4-4196-bef3-6142148156ae admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:04.644892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:04.649964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:04.650218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:04.654546 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] PATH_INFO: `/v3/users/e36c44696a0e4988b6a316baa8f8ff02` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:04.663415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 913/1832] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:04.664615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1800e-fde4-4196-bef3-6142148156ae admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:04.665148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36c44696a0e4988b6a316baa8f8ff02)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:04.676938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:04.690409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1800e-fde4-4196-bef3-6142148156ae admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:04.704763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec5dc7-41b5-416d-8fa5-9cb0dd2fd7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:04.705472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec5dc7-41b5-416d-8fa5-9cb0dd2fd7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:04.707449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec5dc7-41b5-416d-8fa5-9cb0dd2fd7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:04.707765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec5dc7-41b5-416d-8fa5-9cb0dd2fd7bf admin admin] PATH_INFO: `/v3/projects/457a7381083e4ded9ec49305c290df4d/users/9d6ec21287f94c3abbbaf358edd37b49/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:04.714027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec5dc7-41b5-416d-8fa5-9cb0dd2fd7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=457a7381083e4ded9ec49305c290df4d, user_id=9d6ec21287f94c3abbbaf358edd37b49, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:04.723833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec5dc7-41b5-416d-8fa5-9cb0dd2fd7bf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:04.757852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 914/1833] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:04 2022] PUT /identity/v3/projects/457a7381083e4ded9ec49305c290df4d/users/9d6ec21287f94c3abbbaf358edd37b49/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:04.768427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac42bf-eed1-4be0-ba72-c0f707a36530 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:04.768880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac42bf-eed1-4be0-ba72-c0f707a36530 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:04.769359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac42bf-eed1-4be0-ba72-c0f707a36530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:04.806079 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:04.879672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36c44696a0e4988b6a316baa8f8ff02'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:04.887086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1aac42bf-eed1-4be0-ba72-c0f707a36530 None None] MFA Rules not processed for user `9d6ec21287f94c3abbbaf358edd37b49`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:04.889298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1aac42bf-eed1-4be0-ba72-c0f707a36530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:04.895635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36c44696a0e4988b6a316baa8f8ff02'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:04.923972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36c44696a0e4988b6a316baa8f8ff02'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:04.925053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36c44696a0e4988b6a316baa8f8ff02'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:04.963615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36c44696a0e4988b6a316baa8f8ff02'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:04.981231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 920/1834] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:04 2022] DELETE /identity/v3/users/e36c44696a0e4988b6a316baa8f8ff02 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:04.982179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:04.983939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:05.008390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:05.068544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 915/1835] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:05.070031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecdbeb-a2a6-40cc-9788-fae025609ff8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:05.070320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecdbeb-a2a6-40cc-9788-fae025609ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:05.070598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecdbeb-a2a6-40cc-9788-fae025609ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:05.125806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-feecdbeb-a2a6-40cc-9788-fae025609ff8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:05.129376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-feecdbeb-a2a6-40cc-9788-fae025609ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:05.264077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202c359-28b3-42a0-9cd8-7eac7dc51fd8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:05.268790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 916/1836] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:05.269848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecdbeb-a2a6-40cc-9788-fae025609ff8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:05.276460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-feecdbeb-a2a6-40cc-9788-fae025609ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:05.282528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:05.283305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:05.283594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:05.284377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] PATH_INFO: `/v3/users/44ce284e0f124104a9ffc104d7b573ce` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:05.291634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ce284e0f124104a9ffc104d7b573ce)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:05.293741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:05.445926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecdbeb-a2a6-40cc-9788-fae025609ff8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:05.458987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ce284e0f124104a9ffc104d7b573ce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:05.467273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38594585-455c-46d4-84fa-7b076e165892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:05.470260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38594585-455c-46d4-84fa-7b076e165892 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:05.471933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38594585-455c-46d4-84fa-7b076e165892 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:05.475565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38594585-455c-46d4-84fa-7b076e165892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:05.480483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ce284e0f124104a9ffc104d7b573ce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:05.522872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ce284e0f124104a9ffc104d7b573ce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:05.524011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ce284e0f124104a9ffc104d7b573ce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:05.544869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ce284e0f124104a9ffc104d7b573ce'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:05.578212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 921/1837] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:04 2022] DELETE /identity/v3/users/44ce284e0f124104a9ffc104d7b573ce => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:05.579681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:05.588447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:05.599775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:05.666514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38594585-455c-46d4-84fa-7b076e165892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:05.669051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38594585-455c-46d4-84fa-7b076e165892 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:05.695268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 917/1838] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:05.697581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0473a2b-d7e2-40fb-8c5a-375bdd8d792a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:05.698081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0473a2b-d7e2-40fb-8c5a-375bdd8d792a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:05.698550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0473a2b-d7e2-40fb-8c5a-375bdd8d792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:05.739138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e0473a2b-d7e2-40fb-8c5a-375bdd8d792a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:05.742138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e0473a2b-d7e2-40fb-8c5a-375bdd8d792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:05.799038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3abc-e8b9-4054-9081-1ab8a7dfd7da admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:05.820404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995a08-6b89-4f4a-9a2a-fcddcf905f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:05.822104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995a08-6b89-4f4a-9a2a-fcddcf905f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:05.822450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995a08-6b89-4f4a-9a2a-fcddcf905f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:05.826257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995a08-6b89-4f4a-9a2a-fcddcf905f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:05.841472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9b995a08-6b89-4f4a-9a2a-fcddcf905f06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:05.959235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:05.979766 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 918/1839] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:05.980748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0473a2b-d7e2-40fb-8c5a-375bdd8d792a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:05.993091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e0473a2b-d7e2-40fb-8c5a-375bdd8d792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:05.997407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995a08-6b89-4f4a-9a2a-fcddcf905f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:05.999244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995a08-6b89-4f4a-9a2a-fcddcf905f06 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:06.030868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 922/1840] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:06.049440 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995a08-6b89-4f4a-9a2a-fcddcf905f06 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:06.088288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995a08-6b89-4f4a-9a2a-fcddcf905f06 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:06.105086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e680e23-7144-49e2-a338-f5c7a3bcc694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:06.105735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e680e23-7144-49e2-a338-f5c7a3bcc694 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:06.106016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e680e23-7144-49e2-a338-f5c7a3bcc694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:06.110445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e680e23-7144-49e2-a338-f5c7a3bcc694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:06.142821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e680e23-7144-49e2-a338-f5c7a3bcc694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:06.143793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0473a2b-d7e2-40fb-8c5a-375bdd8d792a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:06.145752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e680e23-7144-49e2-a338-f5c7a3bcc694 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:06.159038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:06.159700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:06.159985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:06.160821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:06.166182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:06.188346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 923/1841] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:06.190220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e680e23-7144-49e2-a338-f5c7a3bcc694 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:06.195878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e680e23-7144-49e2-a338-f5c7a3bcc694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:06.284720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:06.289484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:06.312670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 919/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:06.445516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e680e23-7144-49e2-a338-f5c7a3bcc694 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:06.465749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:06.466913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:06.468788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:06.470056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:06.479336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:06.513439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:06.515121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:06.544250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 924/1843] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:07.183182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:07.187916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:07.218819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1913c47-f536-455f-aaa0-445a9b6c435b service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:07.234682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:07.267619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:07.269678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:07.271199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] PATH_INFO: `/v3/projects/d7931ae0b5ca4574a09052e09a8136b6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:07.275528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7931ae0b5ca4574a09052e09a8136b6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:07.281998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:07.373431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:07.375562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:07.400094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f8275-bf50-4ebe-a079-0eff1b5b89e2 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:07.431024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:07.432611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:07.433076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:07.433544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] PATH_INFO: `/v3/projects/de92aa7d97e44b3a847fa74db90c8f58` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:07.439433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de92aa7d97e44b3a847fa74db90c8f58)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:07.442365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:07.450171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:07.522821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7931ae0b5ca4574a09052e09a8136b6', 'request_id': 'req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.552270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7931ae0b5ca4574a09052e09a8136b6', 'request_id': 'req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.572128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7931ae0b5ca4574a09052e09a8136b6', 'request_id': 'req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.575149 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de92aa7d97e44b3a847fa74db90c8f58', 'request_id': 'req-1665521c-0a97-4ae3-9d7e-b3129bfaa177'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.602209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de92aa7d97e44b3a847fa74db90c8f58', 'request_id': 'req-1665521c-0a97-4ae3-9d7e-b3129bfaa177'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.607055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] The token cache is being invalidate because project d7931ae0b5ca4574a09052e09a8136b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:07.607302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.608351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.615174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de92aa7d97e44b3a847fa74db90c8f58', 'request_id': 'req-1665521c-0a97-4ae3-9d7e-b3129bfaa177'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.621963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 920/1844] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:07 2022] DELETE /identity/v3/projects/d7931ae0b5ca4574a09052e09a8136b6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:07.628349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:07.638584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:07.639009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] The token cache is being invalidate because project de92aa7d97e44b3a847fa74db90c8f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:07.639526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.640688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.645906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 925/1845] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:07 2022] DELETE /identity/v3/projects/de92aa7d97e44b3a847fa74db90c8f58 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:07.650909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:07.653698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:07.712681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:07.765553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665521c-0a97-4ae3-9d7e-b3129bfaa177 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:07.779039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:07.779739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:07.780030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:07.780562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] PATH_INFO: `/v3/users/8e3b75f4cb77455ca5e7317aa4ce1415` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:07.790266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3b75f4cb77455ca5e7317aa4ce1415)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:07.807466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:07.836370 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9bf87-bdbc-410b-a64c-b5f30c4ab4e1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:07.851577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:07.852333 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:07.852659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:07.852887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] PATH_INFO: `/v3/users/14d035143b614ce7a445d1d8b125f78b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:07.856067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14d035143b614ce7a445d1d8b125f78b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:07.858062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:07.942687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3b75f4cb77455ca5e7317aa4ce1415'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:07.966178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3b75f4cb77455ca5e7317aa4ce1415'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:08.018497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3b75f4cb77455ca5e7317aa4ce1415'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:08.021229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3b75f4cb77455ca5e7317aa4ce1415'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:08.021698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14d035143b614ce7a445d1d8b125f78b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:08.038810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3b75f4cb77455ca5e7317aa4ce1415'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:08.051853 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14d035143b614ce7a445d1d8b125f78b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:08.052750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14d035143b614ce7a445d1d8b125f78b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:08.054687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 926/1846] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:07 2022] DELETE /identity/v3/users/8e3b75f4cb77455ca5e7317aa4ce1415 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:50:08.065670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14d035143b614ce7a445d1d8b125f78b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:08.066323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c9aaa4d3-5550-40bb-bf8d-b33d26284c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14d035143b614ce7a445d1d8b125f78b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:08.091655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 921/1847] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:07 2022] DELETE /identity/v3/users/14d035143b614ce7a445d1d8b125f78b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:08.870732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:08.872814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:08.999223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a808319-2cb2-4a12-9071-b2481a7a33e8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:09.076634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:09.077372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.077785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.078328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] PATH_INFO: `/v3/projects/6059bff2ee594c86abdc8db5a4a06d5c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.082387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6059bff2ee594c86abdc8db5a4a06d5c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:09.084184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:09.086157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:09.163016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6059bff2ee594c86abdc8db5a4a06d5c', 'request_id': 'req-b5dbdebd-f740-4465-b893-65b309fadc89'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:09.175757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6059bff2ee594c86abdc8db5a4a06d5c', 'request_id': 'req-b5dbdebd-f740-4465-b893-65b309fadc89'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:09.185969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6059bff2ee594c86abdc8db5a4a06d5c', 'request_id': 'req-b5dbdebd-f740-4465-b893-65b309fadc89'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:09.222554 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] The token cache is being invalidate because project 6059bff2ee594c86abdc8db5a4a06d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:09.223418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:09.225128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b5dbdebd-f740-4465-b893-65b309fadc89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:09.228052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 927/1848] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:08 2022] DELETE /identity/v3/projects/6059bff2ee594c86abdc8db5a4a06d5c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:09.232667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8677e-58f5-4e50-a5a0-ba0791f81ac6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.233613 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8677e-58f5-4e50-a5a0-ba0791f81ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.234236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8677e-58f5-4e50-a5a0-ba0791f81ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.257339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-63a8677e-58f5-4e50-a5a0-ba0791f81ac6 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:09.259038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-63a8677e-58f5-4e50-a5a0-ba0791f81ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:09.293343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:09.328810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 922/1849] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:09.337007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99dab-7be5-42e0-989e-399af9e522e3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.337401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99dab-7be5-42e0-989e-399af9e522e3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.337773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99dab-7be5-42e0-989e-399af9e522e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.359893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bdb99dab-7be5-42e0-989e-399af9e522e3 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:09.361782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bdb99dab-7be5-42e0-989e-399af9e522e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:09.383496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 928/1850] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:09.387550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8677e-58f5-4e50-a5a0-ba0791f81ac6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:09.404540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8677e-58f5-4e50-a5a0-ba0791f81ac6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:09.439296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ef264-646e-4011-bd02-0ef1ac229d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:09.440020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ef264-646e-4011-bd02-0ef1ac229d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.440365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ef264-646e-4011-bd02-0ef1ac229d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.440653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ef264-646e-4011-bd02-0ef1ac229d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.441447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ef264-646e-4011-bd02-0ef1ac229d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:09.441929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ef264-646e-4011-bd02-0ef1ac229d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:09.443585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ef264-646e-4011-bd02-0ef1ac229d7f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:09.463104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 923/1851] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:50:09.467016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99dab-7be5-42e0-989e-399af9e522e3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:09.478556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99dab-7be5-42e0-989e-399af9e522e3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:09.489783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60246a-15cb-4d6c-81fb-f5c329f6c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:09.491368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60246a-15cb-4d6c-81fb-f5c329f6c48b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.491800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60246a-15cb-4d6c-81fb-f5c329f6c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.492225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60246a-15cb-4d6c-81fb-f5c329f6c48b admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.493310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60246a-15cb-4d6c-81fb-f5c329f6c48b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:09.496589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60246a-15cb-4d6c-81fb-f5c329f6c48b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:09.546371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 929/1852] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:09 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:09.548058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ef264-646e-4011-bd02-0ef1ac229d7f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:09.563020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ef264-646e-4011-bd02-0ef1ac229d7f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:09.675744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ecb1-2f8c-49e6-80d2-f64ca2cb16d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:09.679349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ecb1-2f8c-49e6-80d2-f64ca2cb16d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.679843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ecb1-2f8c-49e6-80d2-f64ca2cb16d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.680343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ecb1-2f8c-49e6-80d2-f64ca2cb16d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.681195 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7ecb1-2f8c-49e6-80d2-f64ca2cb16d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:09.683630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7ecb1-2f8c-49e6-80d2-f64ca2cb16d5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:09.722092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 924/1853] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:09 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:50:09.725584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60246a-15cb-4d6c-81fb-f5c329f6c48b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:09.737564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60246a-15cb-4d6c-81fb-f5c329f6c48b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:09.752752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a67a3-5662-4be0-9620-8dc6342d9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:09.753685 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a67a3-5662-4be0-9620-8dc6342d9358 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.754520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a67a3-5662-4be0-9620-8dc6342d9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.754790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a67a3-5662-4be0-9620-8dc6342d9358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.755534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a67a3-5662-4be0-9620-8dc6342d9358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:09.757151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a67a3-5662-4be0-9620-8dc6342d9358 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:09.794490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 930/1854] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:09.798700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ecb1-2f8c-49e6-80d2-f64ca2cb16d5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:09.831424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ecb1-2f8c-49e6-80d2-f64ca2cb16d5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:09.849234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49fa8c-08a5-404a-a395-1fb432c4b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:09.850044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49fa8c-08a5-404a-a395-1fb432c4b7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.850044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49fa8c-08a5-404a-a395-1fb432c4b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.850309 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49fa8c-08a5-404a-a395-1fb432c4b7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.851194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49fa8c-08a5-404a-a395-1fb432c4b7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:09.852685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49fa8c-08a5-404a-a395-1fb432c4b7c9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:09.880421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a67a3-5662-4be0-9620-8dc6342d9358 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:09.890707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 925/1855] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:09.894170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a67a3-5662-4be0-9620-8dc6342d9358 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:09.907411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaec9d-fd3e-4c50-a79e-f59e2d8e793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:09.908876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaec9d-fd3e-4c50-a79e-f59e2d8e793b admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.909159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaec9d-fd3e-4c50-a79e-f59e2d8e793b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.909433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaec9d-fd3e-4c50-a79e-f59e2d8e793b admin admin] PATH_INFO: `/v3/projects/4c69c4d960444f598ecbe4d5faa68d79/users/4dbecafac35740bf8ca054e9a9fab572/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.928319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaec9d-fd3e-4c50-a79e-f59e2d8e793b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c69c4d960444f598ecbe4d5faa68d79, user_id=4dbecafac35740bf8ca054e9a9fab572, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:09.931551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaec9d-fd3e-4c50-a79e-f59e2d8e793b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:09.950076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 931/1856] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:09 2022] PUT /identity/v3/projects/4c69c4d960444f598ecbe4d5faa68d79/users/4dbecafac35740bf8ca054e9a9fab572/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:09.961615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380c94-6f30-4c2d-ac8f-cef05ab3925c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:09.961911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380c94-6f30-4c2d-ac8f-cef05ab3925c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:09.962188 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380c94-6f30-4c2d-ac8f-cef05ab3925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:09.995013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-43380c94-6f30-4c2d-ac8f-cef05ab3925c None None] MFA Rules not processed for user `4dbecafac35740bf8ca054e9a9fab572`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:09.996261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-43380c94-6f30-4c2d-ac8f-cef05ab3925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:10.093962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 926/1857] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:10.098464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaec9d-fd3e-4c50-a79e-f59e2d8e793b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:10.123861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43380c94-6f30-4c2d-ac8f-cef05ab3925c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:10.125318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-43380c94-6f30-4c2d-ac8f-cef05ab3925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:10.199193 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:10.217891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaec9d-fd3e-4c50-a79e-f59e2d8e793b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:10.225272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2010-70c6-4fcb-8dd5-8a8fa7745f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:10.226031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2010-70c6-4fcb-8dd5-8a8fa7745f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.226318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2010-70c6-4fcb-8dd5-8a8fa7745f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:10.226596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2010-70c6-4fcb-8dd5-8a8fa7745f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:10.227681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2010-70c6-4fcb-8dd5-8a8fa7745f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:10.229790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2010-70c6-4fcb-8dd5-8a8fa7745f58 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:10.275073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 932/1858] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:10 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:10.279009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2010-70c6-4fcb-8dd5-8a8fa7745f58 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:10.290123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43380c94-6f30-4c2d-ac8f-cef05ab3925c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:10.295168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:10.378562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:10.379922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.380521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:10.381000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] PATH_INFO: `/v3/projects/fc5b00a7688e43b4988d3e46569815d3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:10.382392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5b00a7688e43b4988d3e46569815d3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:10.384587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:10.388319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2010-70c6-4fcb-8dd5-8a8fa7745f58 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:10.394795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7784b-b8e3-4297-9135-7d7693ee5fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:10.395544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7784b-b8e3-4297-9135-7d7693ee5fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.395891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7784b-b8e3-4297-9135-7d7693ee5fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:10.396298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7784b-b8e3-4297-9135-7d7693ee5fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:10.397064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7784b-b8e3-4297-9135-7d7693ee5fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:10.399465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7784b-b8e3-4297-9135-7d7693ee5fe3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:10.437310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 933/1859] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:10 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:10.451205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7784b-b8e3-4297-9135-7d7693ee5fe3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:10.460447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5b00a7688e43b4988d3e46569815d3', 'request_id': 'req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:10.470365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5b00a7688e43b4988d3e46569815d3', 'request_id': 'req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:10.478576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5b00a7688e43b4988d3e46569815d3', 'request_id': 'req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:10.479312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7784b-b8e3-4297-9135-7d7693ee5fe3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:10.498421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] The token cache is being invalidate because project fc5b00a7688e43b4988d3e46569815d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:10.499057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:10.500369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-41ea3626-a2f9-4db7-8f7c-69f12fbe3fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:10.507478 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 927/1860] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:10 2022] DELETE /identity/v3/projects/fc5b00a7688e43b4988d3e46569815d3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:10.508930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e10ea-e1c6-48da-9315-0e30c184a03e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.509229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e10ea-e1c6-48da-9315-0e30c184a03e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:10.509532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e10ea-e1c6-48da-9315-0e30c184a03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:10.562301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c84e10ea-e1c6-48da-9315-0e30c184a03e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:10.563761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c84e10ea-e1c6-48da-9315-0e30c184a03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:10.574792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519beac8-ea7f-4ace-9f45-47e64dde80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:10.575972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519beac8-ea7f-4ace-9f45-47e64dde80bd admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.576261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519beac8-ea7f-4ace-9f45-47e64dde80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:10.576544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519beac8-ea7f-4ace-9f45-47e64dde80bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:10.577881 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519beac8-ea7f-4ace-9f45-47e64dde80bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:10.579218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519beac8-ea7f-4ace-9f45-47e64dde80bd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:10.595110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 934/1861] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:10.596072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519beac8-ea7f-4ace-9f45-47e64dde80bd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:10.597903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-519beac8-ea7f-4ace-9f45-47e64dde80bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:10.629998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519beac8-ea7f-4ace-9f45-47e64dde80bd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:10.640105 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa917b-eb02-4c07-8c02-a7c66bba098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:10.641863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa917b-eb02-4c07-8c02-a7c66bba098d admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.642587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa917b-eb02-4c07-8c02-a7c66bba098d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:10.643494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa917b-eb02-4c07-8c02-a7c66bba098d admin admin] PATH_INFO: `/v3/projects/122cfb7b946e4e78a47c5b108483388a/users/f42bc2d39f1e46008b4027e7c12e0fe1/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:10.699208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa917b-eb02-4c07-8c02-a7c66bba098d admin admin] RBAC: Authorizing `identity:create_grant(project_id=122cfb7b946e4e78a47c5b108483388a, user_id=f42bc2d39f1e46008b4027e7c12e0fe1, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:10.701071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 928/1862] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:10.701998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa917b-eb02-4c07-8c02-a7c66bba098d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:10.715232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c5c4c-784a-4a3d-b540-ea1fdfd775f5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.715750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c5c4c-784a-4a3d-b540-ea1fdfd775f5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:10.716365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c5c4c-784a-4a3d-b540-ea1fdfd775f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:10.737701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 935/1863] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:10 2022] PUT /identity/v3/projects/122cfb7b946e4e78a47c5b108483388a/users/f42bc2d39f1e46008b4027e7c12e0fe1/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:10.739873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa917b-eb02-4c07-8c02-a7c66bba098d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:10.774274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-258c5c4c-784a-4a3d-b540-ea1fdfd775f5 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:10.777785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-258c5c4c-784a-4a3d-b540-ea1fdfd775f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:10.790217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:10.878933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa917b-eb02-4c07-8c02-a7c66bba098d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:10.899612 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44ac14-9c10-4156-b0b7-cdba02e14ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:10.900543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44ac14-9c10-4156-b0b7-cdba02e14ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.901357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44ac14-9c10-4156-b0b7-cdba02e14ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:10.901357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44ac14-9c10-4156-b0b7-cdba02e14ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:10.901625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44ac14-9c10-4156-b0b7-cdba02e14ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:10.904991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44ac14-9c10-4156-b0b7-cdba02e14ec2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:10.924087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 936/1864] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:10.925160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44ac14-9c10-4156-b0b7-cdba02e14ec2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:10.940083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44ac14-9c10-4156-b0b7-cdba02e14ec2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:10.944363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 929/1865] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:10.958290 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fda70-4a3a-4055-b0dd-217fb00d0934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:10.960506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fda70-4a3a-4055-b0dd-217fb00d0934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.960506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fda70-4a3a-4055-b0dd-217fb00d0934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:10.961535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fda70-4a3a-4055-b0dd-217fb00d0934 admin admin] PATH_INFO: `/v3/projects/122cfb7b946e4e78a47c5b108483388a/users/f42bc2d39f1e46008b4027e7c12e0fe1/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:10.963849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fda70-4a3a-4055-b0dd-217fb00d0934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122cfb7b946e4e78a47c5b108483388a, user_id=f42bc2d39f1e46008b4027e7c12e0fe1, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:10.964327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c5c4c-784a-4a3d-b540-ea1fdfd775f5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:10.966564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fda70-4a3a-4055-b0dd-217fb00d0934 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:10.970388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:10.975332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c5c4c-784a-4a3d-b540-ea1fdfd775f5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:10.993751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 937/1866] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:10 2022] PUT /identity/v3/projects/122cfb7b946e4e78a47c5b108483388a/users/f42bc2d39f1e46008b4027e7c12e0fe1/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:10.997946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcba22-72ee-47a7-aabb-e2b0efe5f75e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:10.998470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcba22-72ee-47a7-aabb-e2b0efe5f75e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.004546 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcba22-72ee-47a7-aabb-e2b0efe5f75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.035267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4adcba22-72ee-47a7-aabb-e2b0efe5f75e None None] MFA Rules not processed for user `f42bc2d39f1e46008b4027e7c12e0fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:11.037435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4adcba22-72ee-47a7-aabb-e2b0efe5f75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:11.060092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780fe53-ba4c-4315-b4b6-d5e3817852d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:11.060962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780fe53-ba4c-4315-b4b6-d5e3817852d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:11.061297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780fe53-ba4c-4315-b4b6-d5e3817852d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.061578 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780fe53-ba4c-4315-b4b6-d5e3817852d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.062515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780fe53-ba4c-4315-b4b6-d5e3817852d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:11.062829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780fe53-ba4c-4315-b4b6-d5e3817852d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:11.064602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780fe53-ba4c-4315-b4b6-d5e3817852d7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:11.079775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 930/1867] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:50:11.085302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780fe53-ba4c-4315-b4b6-d5e3817852d7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:11.101035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780fe53-ba4c-4315-b4b6-d5e3817852d7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:11.108554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ac4b8-b6a4-4ef9-8fb1-634c3ab1fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:11.109426 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ac4b8-b6a4-4ef9-8fb1-634c3ab1fa2b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:11.109799 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ac4b8-b6a4-4ef9-8fb1-634c3ab1fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.110120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ac4b8-b6a4-4ef9-8fb1-634c3ab1fa2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.111421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ac4b8-b6a4-4ef9-8fb1-634c3ab1fa2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:11.113526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ac4b8-b6a4-4ef9-8fb1-634c3ab1fa2b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:11.146215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 938/1868] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:11.156814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 931/1869] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:11 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:11.157324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcba22-72ee-47a7-aabb-e2b0efe5f75e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:11.158783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4adcba22-72ee-47a7-aabb-e2b0efe5f75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:11.161126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ac4b8-b6a4-4ef9-8fb1-634c3ab1fa2b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:11.246658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcba22-72ee-47a7-aabb-e2b0efe5f75e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:11.255423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ac4b8-b6a4-4ef9-8fb1-634c3ab1fa2b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:11.261976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832792-0110-4cf3-9466-3e0888010873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:11.263010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832792-0110-4cf3-9466-3e0888010873 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:11.263298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832792-0110-4cf3-9466-3e0888010873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.263682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832792-0110-4cf3-9466-3e0888010873 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.264256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832792-0110-4cf3-9466-3e0888010873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:11.266324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832792-0110-4cf3-9466-3e0888010873 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:11.299296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 932/1870] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:11 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:11.304507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832792-0110-4cf3-9466-3e0888010873 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:11.310434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2147d-f3c1-4427-8afd-55e1c9e63ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:11.311087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2147d-f3c1-4427-8afd-55e1c9e63ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:11.311503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2147d-f3c1-4427-8afd-55e1c9e63ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.311634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2147d-f3c1-4427-8afd-55e1c9e63ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.313615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-eed2147d-f3c1-4427-8afd-55e1c9e63ac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:11.318327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832792-0110-4cf3-9466-3e0888010873 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:11.324700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f035f82-a197-42c1-aefe-26302c7108ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:11.325382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035f82-a197-42c1-aefe-26302c7108ad admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:11.325681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035f82-a197-42c1-aefe-26302c7108ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.325945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035f82-a197-42c1-aefe-26302c7108ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.326952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f035f82-a197-42c1-aefe-26302c7108ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:11.328688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f035f82-a197-42c1-aefe-26302c7108ad admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:11.334507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:11.340962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 933/1871] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:50:11.347870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f035f82-a197-42c1-aefe-26302c7108ad admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:11.362495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f035f82-a197-42c1-aefe-26302c7108ad admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:11.375409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1ea66-0d09-43a5-9fc3-d87951e61cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:11.376650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ea66-0d09-43a5-9fc3-d87951e61cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:11.377077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ea66-0d09-43a5-9fc3-d87951e61cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.377371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ea66-0d09-43a5-9fc3-d87951e61cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.378153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1ea66-0d09-43a5-9fc3-d87951e61cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:11.381295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1ea66-0d09-43a5-9fc3-d87951e61cb7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:11.389088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:11.399573 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 934/1872] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:11.400785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1ea66-0d09-43a5-9fc3-d87951e61cb7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:11.408273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2147d-f3c1-4427-8afd-55e1c9e63ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:11.409957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2147d-f3c1-4427-8afd-55e1c9e63ac5 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:11.424042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1ea66-0d09-43a5-9fc3-d87951e61cb7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:11.424256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 939/1873] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:50:11.439346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f0ce3-cd39-4755-a539-a0f4c944f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:11.440831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f0ce3-cd39-4755-a539-a0f4c944f616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:11.441154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f0ce3-cd39-4755-a539-a0f4c944f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.442161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f0ce3-cd39-4755-a539-a0f4c944f616 admin admin] PATH_INFO: `/v3/projects/278ac465b9734f61823242c79e69dfe2/users/e4923ead8eba4ad8aa7202172453371f/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.459438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f0ce3-cd39-4755-a539-a0f4c944f616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278ac465b9734f61823242c79e69dfe2, user_id=e4923ead8eba4ad8aa7202172453371f, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:11.463076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f0ce3-cd39-4755-a539-a0f4c944f616 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:11.497350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 935/1874] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:11 2022] PUT /identity/v3/projects/278ac465b9734f61823242c79e69dfe2/users/e4923ead8eba4ad8aa7202172453371f/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:11.499312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a652428-5d2f-48ac-b9fb-fd4f899678c6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:11.499608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a652428-5d2f-48ac-b9fb-fd4f899678c6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.499889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a652428-5d2f-48ac-b9fb-fd4f899678c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.550062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9a652428-5d2f-48ac-b9fb-fd4f899678c6 None None] MFA Rules not processed for user `e4923ead8eba4ad8aa7202172453371f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:11.552355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9a652428-5d2f-48ac-b9fb-fd4f899678c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:11.644425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 940/1875] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:11.656097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f0ce3-cd39-4755-a539-a0f4c944f616 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:11.658606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f49f0ce3-cd39-4755-a539-a0f4c944f616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:11.729457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f0ce3-cd39-4755-a539-a0f4c944f616 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:11.733738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ede21-5826-43d6-8997-8c66939767ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:11.734484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ede21-5826-43d6-8997-8c66939767ef service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:11.734681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ede21-5826-43d6-8997-8c66939767ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:11.735006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ede21-5826-43d6-8997-8c66939767ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:11.745448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ede21-5826-43d6-8997-8c66939767ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:11.747003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ede21-5826-43d6-8997-8c66939767ef service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:11.757938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 936/1876] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:50:12.515323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a652428-5d2f-48ac-b9fb-fd4f899678c6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:12.517154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9a652428-5d2f-48ac-b9fb-fd4f899678c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:12.607410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a652428-5d2f-48ac-b9fb-fd4f899678c6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:12.612184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:12.613270 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:12.613678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:12.614056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] PATH_INFO: `/v3/users/2991762f970d41f08307804862d2e035` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:12.615392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2991762f970d41f08307804862d2e035)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:12.617506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:12.677751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2991762f970d41f08307804862d2e035'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:12.689014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2991762f970d41f08307804862d2e035'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:12.709345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2991762f970d41f08307804862d2e035'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:12.710110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2991762f970d41f08307804862d2e035'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:12.720657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2991762f970d41f08307804862d2e035'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:12.724452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:12.734447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 941/1877] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:12 2022] DELETE /identity/v3/users/2991762f970d41f08307804862d2e035 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:12.737335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5416d-3476-47ed-b401-3de27d3f6a69 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:12.737773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5416d-3476-47ed-b401-3de27d3f6a69 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:12.737848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5416d-3476-47ed-b401-3de27d3f6a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:12.781442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f4e5416d-3476-47ed-b401-3de27d3f6a69 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:12.782842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f4e5416d-3476-47ed-b401-3de27d3f6a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:12.891677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 937/1878] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:12.905088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:12.907893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:12.999808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c093c3-5acb-460c-8caf-1c8562a7ca44 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:13.003686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b9585-ff65-4fa1-a644-af8c91a6903c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:13.005149 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b9585-ff65-4fa1-a644-af8c91a6903c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:13.005625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b9585-ff65-4fa1-a644-af8c91a6903c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:13.006104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b9585-ff65-4fa1-a644-af8c91a6903c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:13.035428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b9585-ff65-4fa1-a644-af8c91a6903c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:13.036947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b9585-ff65-4fa1-a644-af8c91a6903c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:13.058639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 942/1879] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:13.571544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5416d-3476-47ed-b401-3de27d3f6a69 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:13.573054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f4e5416d-3476-47ed-b401-3de27d3f6a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:13.594229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5416d-3476-47ed-b401-3de27d3f6a69 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:13.601161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:13.602484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:13.603200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:13.603556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] PATH_INFO: `/v3/projects/e32e36d9b13342ca8fc5a12917187c63` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:13.605018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32e36d9b13342ca8fc5a12917187c63)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:13.607270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:13.663013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32e36d9b13342ca8fc5a12917187c63', 'request_id': 'req-4ddea87a-830c-46a7-b0a7-8085912e01b1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.670686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32e36d9b13342ca8fc5a12917187c63', 'request_id': 'req-4ddea87a-830c-46a7-b0a7-8085912e01b1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.676142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:13.678014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32e36d9b13342ca8fc5a12917187c63', 'request_id': 'req-4ddea87a-830c-46a7-b0a7-8085912e01b1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.695699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] The token cache is being invalidate because project e32e36d9b13342ca8fc5a12917187c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:13.696275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.696631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.698521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 938/1880] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:13 2022] DELETE /identity/v3/projects/e32e36d9b13342ca8fc5a12917187c63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:50:13.702532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b9585-ff65-4fa1-a644-af8c91a6903c service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:13.712963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b9585-ff65-4fa1-a644-af8c91a6903c service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:13.787608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:13.789910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:13.790216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:13.790495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] PATH_INFO: `/v3/users/9d6ec21287f94c3abbbaf358edd37b49` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:13.791796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6ec21287f94c3abbbaf358edd37b49)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:13.793965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:13.896932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6ec21287f94c3abbbaf358edd37b49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.911724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6ec21287f94c3abbbaf358edd37b49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.942866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6ec21287f94c3abbbaf358edd37b49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.943717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6ec21287f94c3abbbaf358edd37b49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.965167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6ec21287f94c3abbbaf358edd37b49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:13.978374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 943/1881] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:13 2022] DELETE /identity/v3/users/9d6ec21287f94c3abbbaf358edd37b49 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:14.257864 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:14.259870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:14.274526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddea87a-830c-46a7-b0a7-8085912e01b1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:14.348757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:14.349713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:14.350124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:14.350407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] PATH_INFO: `/v3/users/4dbecafac35740bf8ca054e9a9fab572` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:14.351660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbecafac35740bf8ca054e9a9fab572)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:14.354241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:14.403291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbecafac35740bf8ca054e9a9fab572'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.430465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbecafac35740bf8ca054e9a9fab572'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.431920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbecafac35740bf8ca054e9a9fab572'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.473415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbecafac35740bf8ca054e9a9fab572'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.474794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef414fc1-eb5e-45fd-926c-823e07b209f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbecafac35740bf8ca054e9a9fab572'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.483284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:14.485497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:14.507049 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 939/1882] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:14 2022] DELETE /identity/v3/users/4dbecafac35740bf8ca054e9a9fab572 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:14.511457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6001a0-7cab-49c8-925a-68d09234a244 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:14.511834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a89ed6-6247-4584-8efe-bf5a5b2108ca None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:14.512267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a89ed6-6247-4584-8efe-bf5a5b2108ca None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:14.512762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a89ed6-6247-4584-8efe-bf5a5b2108ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:14.539651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-46a89ed6-6247-4584-8efe-bf5a5b2108ca None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:14.541074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-46a89ed6-6247-4584-8efe-bf5a5b2108ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:14.554930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:14.632693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 940/1883] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:14.635018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:14.635691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:14.635980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:14.636319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] PATH_INFO: `/v3/projects/457a7381083e4ded9ec49305c290df4d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:14.637538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457a7381083e4ded9ec49305c290df4d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:14.639595 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:14.694936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a89ed6-6247-4584-8efe-bf5a5b2108ca None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:14.696405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-46a89ed6-6247-4584-8efe-bf5a5b2108ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:14.714925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457a7381083e4ded9ec49305c290df4d', 'request_id': 'req-443a920c-d4e0-4169-bd39-df5838885db7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.727706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457a7381083e4ded9ec49305c290df4d', 'request_id': 'req-443a920c-d4e0-4169-bd39-df5838885db7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.728381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:14.746572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457a7381083e4ded9ec49305c290df4d', 'request_id': 'req-443a920c-d4e0-4169-bd39-df5838885db7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.776406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] The token cache is being invalidate because project 457a7381083e4ded9ec49305c290df4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:14.778694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.779562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-443a920c-d4e0-4169-bd39-df5838885db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:14.782790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 944/1884] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:14 2022] DELETE /identity/v3/projects/457a7381083e4ded9ec49305c290df4d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:14.787504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a2fcb-f2c8-49d4-8d66-71082b0b7d4b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:14.789018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a2fcb-f2c8-49d4-8d66-71082b0b7d4b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:14.789591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a2fcb-f2c8-49d4-8d66-71082b0b7d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:14.822733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8a9a2fcb-f2c8-49d4-8d66-71082b0b7d4b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:14.824168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a9a2fcb-f2c8-49d4-8d66-71082b0b7d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:14.829756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a89ed6-6247-4584-8efe-bf5a5b2108ca None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:14.897031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 945/1885] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:14.905962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a333-8780-4616-973b-64efca1452d8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:14.906268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a333-8780-4616-973b-64efca1452d8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:14.906532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a333-8780-4616-973b-64efca1452d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:14.915536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c721d25-886f-4228-ac79-a7f6341e87a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:14.917402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c721d25-886f-4228-ac79-a7f6341e87a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:14.917890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c721d25-886f-4228-ac79-a7f6341e87a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:14.918855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c721d25-886f-4228-ac79-a7f6341e87a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:14.922934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0c721d25-886f-4228-ac79-a7f6341e87a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:14.928462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e4f1a333-8780-4616-973b-64efca1452d8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:14.929682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e4f1a333-8780-4616-973b-64efca1452d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:14.943491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c721d25-886f-4228-ac79-a7f6341e87a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:14.944944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c721d25-886f-4228-ac79-a7f6341e87a9 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:14.950893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 946/1886] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:14.952112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1a333-8780-4616-973b-64efca1452d8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:14.963889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 941/1887] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:14.966413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1a333-8780-4616-973b-64efca1452d8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:14.970957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:14.971591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:14.971870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:14.972143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:14.972943 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:14.973840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:14.975151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:14.997048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c721d25-886f-4228-ac79-a7f6341e87a9 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:14.997301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 947/1888] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:50:15.012421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c721d25-886f-4228-ac79-a7f6341e87a9 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:15.019116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b330ac-9ae7-4297-9e4e-2f1e5e18c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:15.020442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b330ac-9ae7-4297-9e4e-2f1e5e18c4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.020442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b330ac-9ae7-4297-9e4e-2f1e5e18c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.020442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b330ac-9ae7-4297-9e4e-2f1e5e18c4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:15.021243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b330ac-9ae7-4297-9e4e-2f1e5e18c4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:15.023268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b330ac-9ae7-4297-9e4e-2f1e5e18c4c4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:15.078222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:15.081118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:15.091438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 942/1889] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:14 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:15.096399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b330ac-9ae7-4297-9e4e-2f1e5e18c4c4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:15.133768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38ffb-f7a3-4fab-8561-425b63c4f9b4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:15.199785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:15.244223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b330ac-9ae7-4297-9e4e-2f1e5e18c4c4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:15.251610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222fcff-5913-489a-b447-1b1add3ebd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:15.253171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222fcff-5913-489a-b447-1b1add3ebd51 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.254217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222fcff-5913-489a-b447-1b1add3ebd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.255569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222fcff-5913-489a-b447-1b1add3ebd51 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:15.257082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222fcff-5913-489a-b447-1b1add3ebd51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:15.259468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222fcff-5913-489a-b447-1b1add3ebd51 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:15.260884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:15.261629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.261987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.262333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] PATH_INFO: `/v3/users/e4923ead8eba4ad8aa7202172453371f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:15.265276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4923ead8eba4ad8aa7202172453371f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:15.266672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:15.301758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 943/1890] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:15 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:15.307514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222fcff-5913-489a-b447-1b1add3ebd51 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:15.321440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222fcff-5913-489a-b447-1b1add3ebd51 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:15.326871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4923ead8eba4ad8aa7202172453371f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:15.328064 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a011b4a-4921-4845-98bb-7084d21d4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:15.329100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a011b4a-4921-4845-98bb-7084d21d4eba admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.329998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a011b4a-4921-4845-98bb-7084d21d4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.330462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a011b4a-4921-4845-98bb-7084d21d4eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:15.331437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a011b4a-4921-4845-98bb-7084d21d4eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:15.334283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a011b4a-4921-4845-98bb-7084d21d4eba admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:15.339211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4923ead8eba4ad8aa7202172453371f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:15.360727 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 944/1891] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:15.362273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a011b4a-4921-4845-98bb-7084d21d4eba admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:15.367509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4923ead8eba4ad8aa7202172453371f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:15.368887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4923ead8eba4ad8aa7202172453371f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:15.381455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cee91693-79dd-439e-9fdb-476ccc9aa3d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4923ead8eba4ad8aa7202172453371f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:15.386122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a011b4a-4921-4845-98bb-7084d21d4eba admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:15.392907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 948/1892] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:15 2022] DELETE /identity/v3/users/e4923ead8eba4ad8aa7202172453371f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:15.395173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ccf8-ccc1-408f-aab5-b3c5463e3f7c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.395466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ccf8-ccc1-408f-aab5-b3c5463e3f7c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.396647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ccf8-ccc1-408f-aab5-b3c5463e3f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:15.403651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc01564-6e19-4bce-ab4f-64543d1dfa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:15.404362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc01564-6e19-4bce-ab4f-64543d1dfa8b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.404642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc01564-6e19-4bce-ab4f-64543d1dfa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.404917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc01564-6e19-4bce-ab4f-64543d1dfa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:15.405628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc01564-6e19-4bce-ab4f-64543d1dfa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:15.407276 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc01564-6e19-4bce-ab4f-64543d1dfa8b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:15.418134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0325ccf8-ccc1-408f-aab5-b3c5463e3f7c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:15.434307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0325ccf8-ccc1-408f-aab5-b3c5463e3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:15.450718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 945/1893] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:15.460118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc01564-6e19-4bce-ab4f-64543d1dfa8b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:15.462610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0fc01564-6e19-4bce-ab4f-64543d1dfa8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:15.483825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc01564-6e19-4bce-ab4f-64543d1dfa8b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:15.501220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:15.509864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 949/1894] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:15.561326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3089f6-2ef4-480e-b07f-399771a6615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:15.562180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3089f6-2ef4-480e-b07f-399771a6615a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.562306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3089f6-2ef4-480e-b07f-399771a6615a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.562588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3089f6-2ef4-480e-b07f-399771a6615a admin admin] PATH_INFO: `/v3/projects/bcf023404f5f4a679174c3bf4614bcd5/users/ad3f6c4fe6b249cda8ac1099ae6f2cf1/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:15.578593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ccf8-ccc1-408f-aab5-b3c5463e3f7c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:15.584335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0325ccf8-ccc1-408f-aab5-b3c5463e3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:15.586099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3089f6-2ef4-480e-b07f-399771a6615a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf023404f5f4a679174c3bf4614bcd5, user_id=ad3f6c4fe6b249cda8ac1099ae6f2cf1, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:15.589186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3089f6-2ef4-480e-b07f-399771a6615a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:15.610231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 946/1895] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:15 2022] PUT /identity/v3/projects/bcf023404f5f4a679174c3bf4614bcd5/users/ad3f6c4fe6b249cda8ac1099ae6f2cf1/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:15.621411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f3c95-8af3-4546-b12e-6a6f8875e54c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.622649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f3c95-8af3-4546-b12e-6a6f8875e54c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.623139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f3c95-8af3-4546-b12e-6a6f8875e54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:15.665815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ccf8-ccc1-408f-aab5-b3c5463e3f7c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:15.673046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:15.677143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f09f3c95-8af3-4546-b12e-6a6f8875e54c None None] MFA Rules not processed for user `ad3f6c4fe6b249cda8ac1099ae6f2cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:15.678398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f09f3c95-8af3-4546-b12e-6a6f8875e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:15.779050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea63200-23c0-4079-b95d-49bf67d354aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:15.779736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea63200-23c0-4079-b95d-49bf67d354aa service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.779964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea63200-23c0-4079-b95d-49bf67d354aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.780235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea63200-23c0-4079-b95d-49bf67d354aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:15.842987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 947/1896] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:15.861972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f3c95-8af3-4546-b12e-6a6f8875e54c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:15.863853 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f09f3c95-8af3-4546-b12e-6a6f8875e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:15.911050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea63200-23c0-4079-b95d-49bf67d354aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:15.912588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea63200-23c0-4079-b95d-49bf67d354aa service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:15.932761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 950/1897] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:50:15.983901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f3c95-8af3-4546-b12e-6a6f8875e54c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:15.989045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db698b-7413-4d6a-89d6-97ff11fef6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:15.989932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db698b-7413-4d6a-89d6-97ff11fef6cb service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:15.990362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db698b-7413-4d6a-89d6-97ff11fef6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:15.991120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db698b-7413-4d6a-89d6-97ff11fef6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:16.001338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db698b-7413-4d6a-89d6-97ff11fef6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:16.003254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db698b-7413-4d6a-89d6-97ff11fef6cb service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:16.013939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 948/1898] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:50:16.038583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea63200-23c0-4079-b95d-49bf67d354aa service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:16.054597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea63200-23c0-4079-b95d-49bf67d354aa service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:16.061527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:16.062334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:16.062590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:16.062866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] PATH_INFO: `/v3/users/ad3f6c4fe6b249cda8ac1099ae6f2cf1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:16.064155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3f6c4fe6b249cda8ac1099ae6f2cf1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:16.067130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:16.154769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3f6c4fe6b249cda8ac1099ae6f2cf1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.169828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3f6c4fe6b249cda8ac1099ae6f2cf1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.195961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3f6c4fe6b249cda8ac1099ae6f2cf1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.196707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3f6c4fe6b249cda8ac1099ae6f2cf1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.208305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cd356155-97ae-4699-b4dc-accf8774252c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3f6c4fe6b249cda8ac1099ae6f2cf1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.225372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 951/1899] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:16 2022] DELETE /identity/v3/users/ad3f6c4fe6b249cda8ac1099ae6f2cf1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:16.231277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cafcc6-4ed1-49ff-b441-cbaa29743f4a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:16.231706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cafcc6-4ed1-49ff-b441-cbaa29743f4a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:16.232204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cafcc6-4ed1-49ff-b441-cbaa29743f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:16.264613 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e7cafcc6-4ed1-49ff-b441-cbaa29743f4a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:16.267189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e7cafcc6-4ed1-49ff-b441-cbaa29743f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:16.313635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:16.374754 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 949/1900] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:16.386159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58c84-fcfa-4338-b49d-31170231d204 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:16.386441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58c84-fcfa-4338-b49d-31170231d204 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:16.386716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c58c84-fcfa-4338-b49d-31170231d204 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:16.388829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 952/1901] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:50:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:50:16.391390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58c84-fcfa-4338-b49d-31170231d204 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:16.393192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-93c58c84-fcfa-4338-b49d-31170231d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:16.398109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fa00b-9da8-40fe-a95b-ce23aa596179 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:16.399075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fa00b-9da8-40fe-a95b-ce23aa596179 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:16.399504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fa00b-9da8-40fe-a95b-ce23aa596179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:16.458712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-493fa00b-9da8-40fe-a95b-ce23aa596179 None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:16.460044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-493fa00b-9da8-40fe-a95b-ce23aa596179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:16.464173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:16.509463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c58c84-fcfa-4338-b49d-31170231d204 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:16.513173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59a827-3016-486a-b65d-0587a8d9b23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:16.515023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59a827-3016-486a-b65d-0587a8d9b23b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:16.515383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59a827-3016-486a-b65d-0587a8d9b23b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:16.516104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59a827-3016-486a-b65d-0587a8d9b23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:16.527493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59a827-3016-486a-b65d-0587a8d9b23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:16.529092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59a827-3016-486a-b65d-0587a8d9b23b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:16.540781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 953/1902] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:16.544834 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 950/1903] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:50:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:16.560948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59a827-3016-486a-b65d-0587a8d9b23b service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:16.563790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ff59a827-3016-486a-b65d-0587a8d9b23b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:16.586273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59a827-3016-486a-b65d-0587a8d9b23b service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:16.595226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d45c8e-33b7-4f32-a91f-061f200853dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:16.596069 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d45c8e-33b7-4f32-a91f-061f200853dc service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:16.596202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d45c8e-33b7-4f32-a91f-061f200853dc service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:16.598641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d45c8e-33b7-4f32-a91f-061f200853dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:16.609586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d45c8e-33b7-4f32-a91f-061f200853dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:16.610701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d45c8e-33b7-4f32-a91f-061f200853dc service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:16.627117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 954/1904] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:16.652489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fa00b-9da8-40fe-a95b-ce23aa596179 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:16.655112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-493fa00b-9da8-40fe-a95b-ce23aa596179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:16.684189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fa00b-9da8-40fe-a95b-ce23aa596179 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:16.690728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:16.691618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:16.691874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:16.692225 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] PATH_INFO: `/v3/projects/4c69c4d960444f598ecbe4d5faa68d79` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:16.693552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c69c4d960444f598ecbe4d5faa68d79)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:16.696285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:16.788123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d45c8e-33b7-4f32-a91f-061f200853dc service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:16.790734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a8d45c8e-33b7-4f32-a91f-061f200853dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:16.812591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c69c4d960444f598ecbe4d5faa68d79', 'request_id': 'req-9ed8655e-67e4-484e-920e-9b021eb7555b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.822775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d45c8e-33b7-4f32-a91f-061f200853dc service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:16.833443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c69c4d960444f598ecbe4d5faa68d79', 'request_id': 'req-9ed8655e-67e4-484e-920e-9b021eb7555b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.845824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c69c4d960444f598ecbe4d5faa68d79', 'request_id': 'req-9ed8655e-67e4-484e-920e-9b021eb7555b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.877523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] The token cache is being invalidate because project 4c69c4d960444f598ecbe4d5faa68d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:16.877825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.878538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:16.880803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 951/1905] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:16 2022] DELETE /identity/v3/projects/4c69c4d960444f598ecbe4d5faa68d79 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:16.885444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:16.887169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:16.971713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:16.974255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:16.974611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:16.977081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:16.977368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] PATH_INFO: `/v3/projects/278ac465b9734f61823242c79e69dfe2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:16.979435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278ac465b9734f61823242c79e69dfe2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:16.985902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.003385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8655e-67e4-484e-920e-9b021eb7555b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.008954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.030510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.031229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.031667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] PATH_INFO: `/v3/users/f42bc2d39f1e46008b4027e7c12e0fe1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.033423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42bc2d39f1e46008b4027e7c12e0fe1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.038273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.121375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278ac465b9734f61823242c79e69dfe2', 'request_id': 'req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.124807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42bc2d39f1e46008b4027e7c12e0fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.137753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278ac465b9734f61823242c79e69dfe2', 'request_id': 'req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.148465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278ac465b9734f61823242c79e69dfe2', 'request_id': 'req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.151065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42bc2d39f1e46008b4027e7c12e0fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.153089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42bc2d39f1e46008b4027e7c12e0fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.165949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42bc2d39f1e46008b4027e7c12e0fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.167929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8b7e863-56bd-4c8f-994f-a73b5e3dba1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42bc2d39f1e46008b4027e7c12e0fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.170920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] The token cache is being invalidate because project 278ac465b9734f61823242c79e69dfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:17.173373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.175392 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.179832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 955/1906] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:16 2022] DELETE /identity/v3/projects/278ac465b9734f61823242c79e69dfe2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:17.181366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.183460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:17.206975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 952/1907] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:16 2022] DELETE /identity/v3/users/f42bc2d39f1e46008b4027e7c12e0fe1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:50:17.206975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1591cec-72cb-40aa-8acd-8c4382bc781d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.206975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1591cec-72cb-40aa-8acd-8c4382bc781d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.220701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1591cec-72cb-40aa-8acd-8c4382bc781d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.262614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d1591cec-72cb-40aa-8acd-8c4382bc781d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:17.264076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d1591cec-72cb-40aa-8acd-8c4382bc781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:17.268151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:17.285282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ae99f-d9a6-44ec-b5bc-f2653c3a5857 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.342125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 953/1908] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:17.350339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd5ea-c9d1-48c1-9564-4ea97cd28b35 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.350847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd5ea-c9d1-48c1-9564-4ea97cd28b35 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.351327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd5ea-c9d1-48c1-9564-4ea97cd28b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.353141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.353802 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.354085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.354354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] PATH_INFO: `/v3/projects/bcf023404f5f4a679174c3bf4614bcd5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.355561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf023404f5f4a679174c3bf4614bcd5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.357560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.376328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fbbfd5ea-c9d1-48c1-9564-4ea97cd28b35 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:17.377819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fbbfd5ea-c9d1-48c1-9564-4ea97cd28b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:17.388065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 954/1909] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:17.391764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfd5ea-c9d1-48c1-9564-4ea97cd28b35 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.405074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfd5ea-c9d1-48c1-9564-4ea97cd28b35 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.416613 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35798-823e-4fdd-b048-40aafcafb536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.418843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35798-823e-4fdd-b048-40aafcafb536 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.419515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35798-823e-4fdd-b048-40aafcafb536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.419907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35798-823e-4fdd-b048-40aafcafb536 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.420892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a35798-823e-4fdd-b048-40aafcafb536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:17.421302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a35798-823e-4fdd-b048-40aafcafb536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.423496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a35798-823e-4fdd-b048-40aafcafb536 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.439643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf023404f5f4a679174c3bf4614bcd5', 'request_id': 'req-d545e7b7-e1e6-4b74-91da-89017ecc2635'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.445418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 955/1910] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:50:17.447961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35798-823e-4fdd-b048-40aafcafb536 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.457123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf023404f5f4a679174c3bf4614bcd5', 'request_id': 'req-d545e7b7-e1e6-4b74-91da-89017ecc2635'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.461901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35798-823e-4fdd-b048-40aafcafb536 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.467085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf023404f5f4a679174c3bf4614bcd5', 'request_id': 'req-d545e7b7-e1e6-4b74-91da-89017ecc2635'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.484247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] The token cache is being invalidate because project bcf023404f5f4a679174c3bf4614bcd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:17.485405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.486138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d545e7b7-e1e6-4b74-91da-89017ecc2635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:17.492397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 956/1911] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:17 2022] DELETE /identity/v3/projects/bcf023404f5f4a679174c3bf4614bcd5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:17.496638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34ea16-7e59-41d2-b2e3-e5ab72702295 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.498067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34ea16-7e59-41d2-b2e3-e5ab72702295 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.498402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34ea16-7e59-41d2-b2e3-e5ab72702295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.522348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:17.536480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2e34ea16-7e59-41d2-b2e3-e5ab72702295 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:17.538941 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2e34ea16-7e59-41d2-b2e3-e5ab72702295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:17.543981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a545e5-7420-483a-92ae-8b6a13ab858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.544777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a545e5-7420-483a-92ae-8b6a13ab858c admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.545160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a545e5-7420-483a-92ae-8b6a13ab858c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.545530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a545e5-7420-483a-92ae-8b6a13ab858c admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.546635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a545e5-7420-483a-92ae-8b6a13ab858c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.549259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a545e5-7420-483a-92ae-8b6a13ab858c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.556540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 957/1912] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:17.558711 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46194a0b-1f51-4495-9e97-0b7278f9da61 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.559189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46194a0b-1f51-4495-9e97-0b7278f9da61 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.559518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46194a0b-1f51-4495-9e97-0b7278f9da61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.593138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-46194a0b-1f51-4495-9e97-0b7278f9da61 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:17.594558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-46194a0b-1f51-4495-9e97-0b7278f9da61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:17.608270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 956/1913] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:17 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:17.609831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a545e5-7420-483a-92ae-8b6a13ab858c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.612724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-26a545e5-7420-483a-92ae-8b6a13ab858c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:17.700105 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 958/1914] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:17.704272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46194a0b-1f51-4495-9e97-0b7278f9da61 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.708963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a545e5-7420-483a-92ae-8b6a13ab858c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.715253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46194a0b-1f51-4495-9e97-0b7278f9da61 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.716068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f490-6a7b-49ab-b20f-0e27a5ac0cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.716804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f490-6a7b-49ab-b20f-0e27a5ac0cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.716986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f490-6a7b-49ab-b20f-0e27a5ac0cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.717263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f490-6a7b-49ab-b20f-0e27a5ac0cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.717943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762f490-6a7b-49ab-b20f-0e27a5ac0cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.719922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762f490-6a7b-49ab-b20f-0e27a5ac0cb6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.722153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c273e5c-57fa-4b9b-b8b6-d5c64cbaa990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.722775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c273e5c-57fa-4b9b-b8b6-d5c64cbaa990 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.723093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c273e5c-57fa-4b9b-b8b6-d5c64cbaa990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.723366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c273e5c-57fa-4b9b-b8b6-d5c64cbaa990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.729393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c273e5c-57fa-4b9b-b8b6-d5c64cbaa990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:17.729393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c273e5c-57fa-4b9b-b8b6-d5c64cbaa990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.729393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c273e5c-57fa-4b9b-b8b6-d5c64cbaa990 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.747726 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 959/1915] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:50:17.748869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c273e5c-57fa-4b9b-b8b6-d5c64cbaa990 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.748999 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 957/1916] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:17 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:17.752979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f490-6a7b-49ab-b20f-0e27a5ac0cb6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.765180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c273e5c-57fa-4b9b-b8b6-d5c64cbaa990 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.771556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9c9f-0144-4d9f-881d-bb4cc931b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.772202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9c9f-0144-4d9f-881d-bb4cc931b0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.773028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9c9f-0144-4d9f-881d-bb4cc931b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.773418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9c9f-0144-4d9f-881d-bb4cc931b0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.773611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f490-6a7b-49ab-b20f-0e27a5ac0cb6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.774704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e9c9f-0144-4d9f-881d-bb4cc931b0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.777532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e9c9f-0144-4d9f-881d-bb4cc931b0e5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.784418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:17.787867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b2ddc-9b56-45bd-9bcc-a7719224e2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.788799 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2ddc-9b56-45bd-9bcc-a7719224e2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.789317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2ddc-9b56-45bd-9bcc-a7719224e2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.789811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2ddc-9b56-45bd-9bcc-a7719224e2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.794470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b2ddc-9b56-45bd-9bcc-a7719224e2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.797482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b2ddc-9b56-45bd-9bcc-a7719224e2b7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.815407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 958/1917] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:50:17.816931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 960/1918] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:17 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:50:17.819498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b2ddc-9b56-45bd-9bcc-a7719224e2b7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.822601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9c9f-0144-4d9f-881d-bb4cc931b0e5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.832417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b2ddc-9b56-45bd-9bcc-a7719224e2b7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.898557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153df2fd-f128-4807-a9ab-0704dd285a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.899595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df2fd-f128-4807-a9ab-0704dd285a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.899947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df2fd-f128-4807-a9ab-0704dd285a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.900285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df2fd-f128-4807-a9ab-0704dd285a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.901065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153df2fd-f128-4807-a9ab-0704dd285a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.904444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153df2fd-f128-4807-a9ab-0704dd285a02 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.924412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 959/1919] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:50:17.926199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153df2fd-f128-4807-a9ab-0704dd285a02 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.927620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9c9f-0144-4d9f-881d-bb4cc931b0e5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.932829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4ab18-0dd2-4748-8532-9b4227e2a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.933665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4ab18-0dd2-4748-8532-9b4227e2a80a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.934091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4ab18-0dd2-4748-8532-9b4227e2a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.935155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4ab18-0dd2-4748-8532-9b4227e2a80a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.935848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4ab18-0dd2-4748-8532-9b4227e2a80a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.938115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4ab18-0dd2-4748-8532-9b4227e2a80a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.939763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153df2fd-f128-4807-a9ab-0704dd285a02 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:17.946012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783307d-c4b8-42e8-9507-647b5a3a4b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:17.947278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783307d-c4b8-42e8-9507-647b5a3a4b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:17.947759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783307d-c4b8-42e8-9507-647b5a3a4b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:17.948229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783307d-c4b8-42e8-9507-647b5a3a4b56 admin admin] PATH_INFO: `/v3/projects/4f55c3636f8547f4a0b0cdede86c83bc/users/e25c359062c04d74a443622b70e2541b/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:17.966948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783307d-c4b8-42e8-9507-647b5a3a4b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f55c3636f8547f4a0b0cdede86c83bc, user_id=e25c359062c04d74a443622b70e2541b, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:17.969756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783307d-c4b8-42e8-9507-647b5a3a4b56 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:17.974988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 961/1920] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:17 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:50:17.976229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4ab18-0dd2-4748-8532-9b4227e2a80a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:17.993859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 960/1921] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:17 2022] PUT /identity/v3/projects/4f55c3636f8547f4a0b0cdede86c83bc/users/e25c359062c04d74a443622b70e2541b/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:17.998657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4ab18-0dd2-4748-8532-9b4227e2a80a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:18.004581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6718c94-def0-4a39-9e0f-ce6fad6afdc8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.005139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6718c94-def0-4a39-9e0f-ce6fad6afdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.005426 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6718c94-def0-4a39-9e0f-ce6fad6afdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.039249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f6718c94-def0-4a39-9e0f-ce6fad6afdc8 None None] MFA Rules not processed for user `e25c359062c04d74a443622b70e2541b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:18.040409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f6718c94-def0-4a39-9e0f-ce6fad6afdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:18.056098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:18.148895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 961/1922] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:18.150167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6718c94-def0-4a39-9e0f-ce6fad6afdc8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:18.151558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f6718c94-def0-4a39-9e0f-ce6fad6afdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:18.172834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b3f98-c58e-4bf7-a987-4e78da690f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:18.173491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b3f98-c58e-4bf7-a987-4e78da690f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.174926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b3f98-c58e-4bf7-a987-4e78da690f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.176114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b3f98-c58e-4bf7-a987-4e78da690f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.176961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b3f98-c58e-4bf7-a987-4e78da690f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:18.180696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b3f98-c58e-4bf7-a987-4e78da690f74 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:18.195241 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 962/1923] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:18.196116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b3f98-c58e-4bf7-a987-4e78da690f74 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:18.197847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-676b3f98-c58e-4bf7-a987-4e78da690f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:18.287233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6718c94-def0-4a39-9e0f-ce6fad6afdc8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:18.294388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:18.295463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.295979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.296488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] PATH_INFO: `/v3/projects/122cfb7b946e4e78a47c5b108483388a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.298155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122cfb7b946e4e78a47c5b108483388a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:18.300995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:18.346446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b3f98-c58e-4bf7-a987-4e78da690f74 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:18.354376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b2559-cc35-4cf7-a91e-b4151fdfa072 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7a3c5f6b9645fb8cd2a65cee4f37c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:18.355354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b2559-cc35-4cf7-a91e-b4151fdfa072 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.355756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b2559-cc35-4cf7-a91e-b4151fdfa072 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.356684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b2559-cc35-4cf7-a91e-b4151fdfa072 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.373991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:18.376675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b2559-cc35-4cf7-a91e-b4151fdfa072 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:18.378650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b2559-cc35-4cf7-a91e-b4151fdfa072 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:18.400577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122cfb7b946e4e78a47c5b108483388a', 'request_id': 'req-7ddf973f-0105-4781-b976-962a83f2f068'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:18.408271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 963/1924] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:18.409291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b2559-cc35-4cf7-a91e-b4151fdfa072 service glance] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:18.414211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122cfb7b946e4e78a47c5b108483388a', 'request_id': 'req-7ddf973f-0105-4781-b976-962a83f2f068'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:18.444364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122cfb7b946e4e78a47c5b108483388a', 'request_id': 'req-7ddf973f-0105-4781-b976-962a83f2f068'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:18.453190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b2559-cc35-4cf7-a91e-b4151fdfa072 service glance] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:18.467828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] The token cache is being invalidate because project 122cfb7b946e4e78a47c5b108483388a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:18.468891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:18.470710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ddf973f-0105-4781-b976-962a83f2f068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:18.475586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 962/1925] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:18 2022] DELETE /identity/v3/projects/122cfb7b946e4e78a47c5b108483388a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:18.480599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026337-1904-4fc5-a660-433c7af516b7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.480986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026337-1904-4fc5-a660-433c7af516b7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.481515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026337-1904-4fc5-a660-433c7af516b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.512131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c7026337-1904-4fc5-a660-433c7af516b7 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:18.513723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c7026337-1904-4fc5-a660-433c7af516b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:18.571124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:18.585100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee661f4-6296-4402-9a0c-9a509266e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:18.586529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee661f4-6296-4402-9a0c-9a509266e719 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.587230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee661f4-6296-4402-9a0c-9a509266e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.587673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee661f4-6296-4402-9a0c-9a509266e719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.588563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee661f4-6296-4402-9a0c-9a509266e719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:18.590838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee661f4-6296-4402-9a0c-9a509266e719 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:18.613316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 963/1926] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:18.621400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109050e-1fdb-4da5-bd96-dd8aa67e5746 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.621796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109050e-1fdb-4da5-bd96-dd8aa67e5746 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.622163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109050e-1fdb-4da5-bd96-dd8aa67e5746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.632965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 964/1927] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:18.636517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee661f4-6296-4402-9a0c-9a509266e719 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:18.642945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5ee661f4-6296-4402-9a0c-9a509266e719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:18.671151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8109050e-1fdb-4da5-bd96-dd8aa67e5746 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:18.674426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee661f4-6296-4402-9a0c-9a509266e719 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:18.677505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8109050e-1fdb-4da5-bd96-dd8aa67e5746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:18.685306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71029d4b-dd0b-4551-b2e0-e5fe98c5c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:18.686116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71029d4b-dd0b-4551-b2e0-e5fe98c5c010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.686421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71029d4b-dd0b-4551-b2e0-e5fe98c5c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.686707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71029d4b-dd0b-4551-b2e0-e5fe98c5c010 admin admin] PATH_INFO: `/v3/projects/cbd05b8a616a4323a73535ac6db4b067/users/09dd051313e045338e9223836d6f6687/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.701140 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 964/1928] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:18.711106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71029d4b-dd0b-4551-b2e0-e5fe98c5c010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd05b8a616a4323a73535ac6db4b067, user_id=09dd051313e045338e9223836d6f6687, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:18.714071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71029d4b-dd0b-4551-b2e0-e5fe98c5c010 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:18.715218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109050e-1fdb-4da5-bd96-dd8aa67e5746 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:18.747919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 965/1929] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:18 2022] PUT /identity/v3/projects/cbd05b8a616a4323a73535ac6db4b067/users/09dd051313e045338e9223836d6f6687/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:18.748231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109050e-1fdb-4da5-bd96-dd8aa67e5746 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:18.751159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9247-9805-4273-8115-cf21c6f51f51 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.751694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9247-9805-4273-8115-cf21c6f51f51 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.752176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9247-9805-4273-8115-cf21c6f51f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.791316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f18c9247-9805-4273-8115-cf21c6f51f51 None None] MFA Rules not processed for user `09dd051313e045338e9223836d6f6687`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:18.792541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f18c9247-9805-4273-8115-cf21c6f51f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:18.881199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc941b-4eae-4bc9-bd89-70d8403ca59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:18.881856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc941b-4eae-4bc9-bd89-70d8403ca59a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.882137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc941b-4eae-4bc9-bd89-70d8403ca59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.882408 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc941b-4eae-4bc9-bd89-70d8403ca59a admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.883197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc941b-4eae-4bc9-bd89-70d8403ca59a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:18.883612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc941b-4eae-4bc9-bd89-70d8403ca59a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:18.885263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc941b-4eae-4bc9-bd89-70d8403ca59a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:18.914924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 965/1930] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:50:18.919066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc941b-4eae-4bc9-bd89-70d8403ca59a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:18.926655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 966/1931] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:18.931757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c9247-9805-4273-8115-cf21c6f51f51 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:18.936270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc941b-4eae-4bc9-bd89-70d8403ca59a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:18.948029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c9247-9805-4273-8115-cf21c6f51f51 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:18.951160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647f5d2-3416-402c-9c42-c17227277b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:18.951708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647f5d2-3416-402c-9c42-c17227277b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.952102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647f5d2-3416-402c-9c42-c17227277b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.952684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647f5d2-3416-402c-9c42-c17227277b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.954726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647f5d2-3416-402c-9c42-c17227277b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:18.956927 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647f5d2-3416-402c-9c42-c17227277b6e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:18.962182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7341b-b9c8-48c3-9db5-ef5d0755348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:18.963357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7341b-b9c8-48c3-9db5-ef5d0755348e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:18.963357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7341b-b9c8-48c3-9db5-ef5d0755348e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:18.963578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7341b-b9c8-48c3-9db5-ef5d0755348e admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:18.964227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7341b-b9c8-48c3-9db5-ef5d0755348e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:18.966237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7341b-b9c8-48c3-9db5-ef5d0755348e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.025092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 966/1932] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:18 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:19.026208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647f5d2-3416-402c-9c42-c17227277b6e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.038734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 967/1933] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:18 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:19.042234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7341b-b9c8-48c3-9db5-ef5d0755348e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.110942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:19.153260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7341b-b9c8-48c3-9db5-ef5d0755348e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.161298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd87b0-7f3c-4c4c-a16f-fed71775f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.162130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd87b0-7f3c-4c4c-a16f-fed71775f4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.162412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd87b0-7f3c-4c4c-a16f-fed71775f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.162724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd87b0-7f3c-4c4c-a16f-fed71775f4d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.163544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd87b0-7f3c-4c4c-a16f-fed71775f4d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.166123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd87b0-7f3c-4c4c-a16f-fed71775f4d4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.236004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 968/1934] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:19 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:50:19.238958 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001e76-dfab-4ef6-b398-7d8cde78d854 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.247040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001e76-dfab-4ef6-b398-7d8cde78d854 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.247841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001e76-dfab-4ef6-b398-7d8cde78d854 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.250586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 969/1935] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:50:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:50:19.252952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647f5d2-3416-402c-9c42-c17227277b6e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.255167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001e76-dfab-4ef6-b398-7d8cde78d854 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.268472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb0d36-67cd-4442-bf8b-15789312a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.269310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb0d36-67cd-4442-bf8b-15789312a98a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.269612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb0d36-67cd-4442-bf8b-15789312a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.269893 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb0d36-67cd-4442-bf8b-15789312a98a admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.270577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb0d36-67cd-4442-bf8b-15789312a98a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.272552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb0d36-67cd-4442-bf8b-15789312a98a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.300171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001e76-dfab-4ef6-b398-7d8cde78d854 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.306742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b7721-cf7b-41ef-a7a3-55354612ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.307309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b7721-cf7b-41ef-a7a3-55354612ea67 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.307591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b7721-cf7b-41ef-a7a3-55354612ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.307864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b7721-cf7b-41ef-a7a3-55354612ea67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.309071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b7721-cf7b-41ef-a7a3-55354612ea67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.310829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b7721-cf7b-41ef-a7a3-55354612ea67 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.313677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 967/1936] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:19 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:50:19.315089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823047d2-6386-4b39-ab9c-f2bc182c494b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.317210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823047d2-6386-4b39-ab9c-f2bc182c494b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.317541 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823047d2-6386-4b39-ab9c-f2bc182c494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.334070 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 970/1937] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:19.334867 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b7721-cf7b-41ef-a7a3-55354612ea67 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.342522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-823047d2-6386-4b39-ab9c-f2bc182c494b None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:19.343941 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-823047d2-6386-4b39-ab9c-f2bc182c494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:19.361082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b7721-cf7b-41ef-a7a3-55354612ea67 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.370253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4fe28-fd7c-4e3a-9465-1b0a1ce305b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.370923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4fe28-fd7c-4e3a-9465-1b0a1ce305b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.371229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4fe28-fd7c-4e3a-9465-1b0a1ce305b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.371510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4fe28-fd7c-4e3a-9465-1b0a1ce305b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.372268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4fe28-fd7c-4e3a-9465-1b0a1ce305b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.375276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4fe28-fd7c-4e3a-9465-1b0a1ce305b6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.395035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:19.400503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 971/1938] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:19.401562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4fe28-fd7c-4e3a-9465-1b0a1ce305b6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.417929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4fe28-fd7c-4e3a-9465-1b0a1ce305b6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.424279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844cd2e-4b8c-4c32-aa19-9c0d942bc83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.425472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844cd2e-4b8c-4c32-aa19-9c0d942bc83a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.427628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844cd2e-4b8c-4c32-aa19-9c0d942bc83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.428145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844cd2e-4b8c-4c32-aa19-9c0d942bc83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.429130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844cd2e-4b8c-4c32-aa19-9c0d942bc83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.430771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844cd2e-4b8c-4c32-aa19-9c0d942bc83a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.446540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 972/1939] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:19.446725 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844cd2e-4b8c-4c32-aa19-9c0d942bc83a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.457916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844cd2e-4b8c-4c32-aa19-9c0d942bc83a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.463921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f7b9-2780-47e1-b259-ee336b673a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.464553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 968/1940] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:50:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:19.465017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f7b9-2780-47e1-b259-ee336b673a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.465017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f7b9-2780-47e1-b259-ee336b673a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.465227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f7b9-2780-47e1-b259-ee336b673a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.465314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823047d2-6386-4b39-ab9c-f2bc182c494b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.465755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5f7b9-2780-47e1-b259-ee336b673a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.467391 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5f7b9-2780-47e1-b259-ee336b673a5d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.478575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823047d2-6386-4b39-ab9c-f2bc182c494b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.484776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 973/1941] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:19.484776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f7b9-2780-47e1-b259-ee336b673a5d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.490337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224de2-85ea-4171-990f-59d2e588db69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.491068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224de2-85ea-4171-990f-59d2e588db69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.491343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224de2-85ea-4171-990f-59d2e588db69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.491616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224de2-85ea-4171-990f-59d2e588db69 admin admin] PATH_INFO: `/v3/projects/31b39f5719e04844bb0fc36ebcc2b0ac/users/fd2d87e179934b48badfd58a99e8d712/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.495941 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f7b9-2780-47e1-b259-ee336b673a5d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.501610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7b30b-cf3e-4375-a1b0-102c28bdf534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.503945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b30b-cf3e-4375-a1b0-102c28bdf534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.504229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b30b-cf3e-4375-a1b0-102c28bdf534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.504512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b30b-cf3e-4375-a1b0-102c28bdf534 admin admin] PATH_INFO: `/v3/projects/f6174522ef16494d97d291911c561881/users/fa938b9797eb4c6e989ef8dc53c16d98/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.511333 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63224de2-85ea-4171-990f-59d2e588db69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b39f5719e04844bb0fc36ebcc2b0ac, user_id=fd2d87e179934b48badfd58a99e8d712, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.514604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63224de2-85ea-4171-990f-59d2e588db69 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.522818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7b30b-cf3e-4375-a1b0-102c28bdf534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6174522ef16494d97d291911c561881, user_id=fa938b9797eb4c6e989ef8dc53c16d98, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.525698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7b30b-cf3e-4375-a1b0-102c28bdf534 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.543729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 969/1942] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:19 2022] PUT /identity/v3/projects/31b39f5719e04844bb0fc36ebcc2b0ac/users/fd2d87e179934b48badfd58a99e8d712/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:19.543729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224de2-85ea-4171-990f-59d2e588db69 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.543729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-63224de2-85ea-4171-990f-59d2e588db69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:19.551596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 974/1943] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:19 2022] PUT /identity/v3/projects/f6174522ef16494d97d291911c561881/users/fa938b9797eb4c6e989ef8dc53c16d98/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:50:19.557081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b0430-c136-4f31-9288-44adbfa47abc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.557992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b0430-c136-4f31-9288-44adbfa47abc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.559074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b0430-c136-4f31-9288-44adbfa47abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.616153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d97b0430-c136-4f31-9288-44adbfa47abc None None] MFA Rules not processed for user `fd2d87e179934b48badfd58a99e8d712`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:19.617386 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d97b0430-c136-4f31-9288-44adbfa47abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:19.626337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224de2-85ea-4171-990f-59d2e588db69 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.692952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 975/1944] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:19.694596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00de7-ed73-40ce-81b4-3e15f289a142 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.695081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00de7-ed73-40ce-81b4-3e15f289a142 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.695438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00de7-ed73-40ce-81b4-3e15f289a142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.700290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb7b1a-d702-487a-bd3d-227a61d2e91a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.700929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb7b1a-d702-487a-bd3d-227a61d2e91a service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.701212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb7b1a-d702-487a-bd3d-227a61d2e91a service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.701521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb7b1a-d702-487a-bd3d-227a61d2e91a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.713665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb7b1a-d702-487a-bd3d-227a61d2e91a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.715468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb7b1a-d702-487a-bd3d-227a61d2e91a service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.729657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 970/1945] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:19.731073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d4b00de7-ed73-40ce-81b4-3e15f289a142 None None] MFA Rules not processed for user `fa938b9797eb4c6e989ef8dc53c16d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:19.731222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb7b1a-d702-487a-bd3d-227a61d2e91a service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.733227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d4b00de7-ed73-40ce-81b4-3e15f289a142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:19.780788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:19.788468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:19.819133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 976/1946] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:19.829674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb7b1a-d702-487a-bd3d-227a61d2e91a service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.832515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00de7-ed73-40ce-81b4-3e15f289a142 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.833934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d4b00de7-ed73-40ce-81b4-3e15f289a142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:19.835835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa28b5-f193-4c09-a7b9-f15ac34a2088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:19.836369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa28b5-f193-4c09-a7b9-f15ac34a2088 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:19.836652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa28b5-f193-4c09-a7b9-f15ac34a2088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:19.836926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa28b5-f193-4c09-a7b9-f15ac34a2088 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:19.838207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa28b5-f193-4c09-a7b9-f15ac34a2088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:19.839749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa28b5-f193-4c09-a7b9-f15ac34a2088 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:19.878167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 971/1947] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:19 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:19.885719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa28b5-f193-4c09-a7b9-f15ac34a2088 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:19.922207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00de7-ed73-40ce-81b4-3e15f289a142 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:19.996698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa28b5-f193-4c09-a7b9-f15ac34a2088 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:20.002600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314b0a1-23c5-42ec-8be5-6b7dd75b5aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:20.014594 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314b0a1-23c5-42ec-8be5-6b7dd75b5aee admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:20.015331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7aa2f-2ac7-4085-a417-5adfe748d491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:20.016062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7aa2f-2ac7-4085-a417-5adfe748d491 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:20.016310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314b0a1-23c5-42ec-8be5-6b7dd75b5aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:20.016423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7aa2f-2ac7-4085-a417-5adfe748d491 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:20.016605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7aa2f-2ac7-4085-a417-5adfe748d491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:20.016852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314b0a1-23c5-42ec-8be5-6b7dd75b5aee admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:20.020133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314b0a1-23c5-42ec-8be5-6b7dd75b5aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:20.024911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314b0a1-23c5-42ec-8be5-6b7dd75b5aee admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:20.078878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 972/1948] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:19 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:50:20.083736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314b0a1-23c5-42ec-8be5-6b7dd75b5aee admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:20.118243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314b0a1-23c5-42ec-8be5-6b7dd75b5aee admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:20.130324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce782f4-d8a1-4be5-b7f4-b8f4b2fa973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:20.131125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce782f4-d8a1-4be5-b7f4-b8f4b2fa973d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:20.131504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce782f4-d8a1-4be5-b7f4-b8f4b2fa973d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:20.133467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce782f4-d8a1-4be5-b7f4-b8f4b2fa973d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:20.134325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce782f4-d8a1-4be5-b7f4-b8f4b2fa973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:20.146588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce782f4-d8a1-4be5-b7f4-b8f4b2fa973d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:20.163826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7aa2f-2ac7-4085-a417-5adfe748d491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:20.165625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7aa2f-2ac7-4085-a417-5adfe748d491 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:20.178244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 973/1949] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:20.185972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce782f4-d8a1-4be5-b7f4-b8f4b2fa973d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:20.198704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce782f4-d8a1-4be5-b7f4-b8f4b2fa973d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:20.204470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd3430-19c3-4bb7-bb86-afeaf13c5747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:20.205304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd3430-19c3-4bb7-bb86-afeaf13c5747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:20.205681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd3430-19c3-4bb7-bb86-afeaf13c5747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:20.206052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd3430-19c3-4bb7-bb86-afeaf13c5747 admin admin] PATH_INFO: `/v3/projects/71f1abf53f994e5b8bf6094321641ea3/users/7956afefc9464d3a9458e2861407e49e/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:20.208549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 977/1950] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:20.227783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd3430-19c3-4bb7-bb86-afeaf13c5747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f1abf53f994e5b8bf6094321641ea3, user_id=7956afefc9464d3a9458e2861407e49e, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:20.230660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd3430-19c3-4bb7-bb86-afeaf13c5747 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:20.252216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 974/1951] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:20 2022] PUT /identity/v3/projects/71f1abf53f994e5b8bf6094321641ea3/users/7956afefc9464d3a9458e2861407e49e/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:20.253466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7aa2f-2ac7-4085-a417-5adfe748d491 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:20.289039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7aa2f-2ac7-4085-a417-5adfe748d491 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:20.390509 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:20.413393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a027d-89cd-4fa0-b86a-70bcf080bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:20.414568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a027d-89cd-4fa0-b86a-70bcf080bd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:20.415006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a027d-89cd-4fa0-b86a-70bcf080bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:20.415387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a027d-89cd-4fa0-b86a-70bcf080bd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:20.416455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a027d-89cd-4fa0-b86a-70bcf080bd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:20.420118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a027d-89cd-4fa0-b86a-70bcf080bd3a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:20.450546 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 978/1952] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:50:20.455077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd3430-19c3-4bb7-bb86-afeaf13c5747 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:20.466730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd3430-19c3-4bb7-bb86-afeaf13c5747 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:20.477615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c7e67-ef1a-43b4-8dc4-1d29d59963d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:20.478574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7e67-ef1a-43b4-8dc4-1d29d59963d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:20.480545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7e67-ef1a-43b4-8dc4-1d29d59963d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:20.480884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7e67-ef1a-43b4-8dc4-1d29d59963d6 admin admin] PATH_INFO: `/v3/projects/71f1abf53f994e5b8bf6094321641ea3/users/7956afefc9464d3a9458e2861407e49e/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:20.483144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c7e67-ef1a-43b4-8dc4-1d29d59963d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f1abf53f994e5b8bf6094321641ea3, user_id=7956afefc9464d3a9458e2861407e49e, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:20.486335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c7e67-ef1a-43b4-8dc4-1d29d59963d6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:20.501260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 975/1953] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:20 2022] PUT /identity/v3/projects/71f1abf53f994e5b8bf6094321641ea3/users/7956afefc9464d3a9458e2861407e49e/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:20.515740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed853-8c69-49a5-872e-ffefa192bed1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:20.516308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed853-8c69-49a5-872e-ffefa192bed1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:20.516872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed853-8c69-49a5-872e-ffefa192bed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:20.569635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9ceed853-8c69-49a5-872e-ffefa192bed1 None None] MFA Rules not processed for user `7956afefc9464d3a9458e2861407e49e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:20.571089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9ceed853-8c69-49a5-872e-ffefa192bed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:20.734735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 979/1954] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:20.751175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c7e67-ef1a-43b4-8dc4-1d29d59963d6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:20.854657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c7e67-ef1a-43b4-8dc4-1d29d59963d6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:20.861705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb355758-be7d-4603-a90c-572fd866c206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:20.862546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb355758-be7d-4603-a90c-572fd866c206 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:20.863436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb355758-be7d-4603-a90c-572fd866c206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:20.863708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb355758-be7d-4603-a90c-572fd866c206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:20.880608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:20.987090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb355758-be7d-4603-a90c-572fd866c206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:20.989119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb355758-be7d-4603-a90c-572fd866c206 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:21.002396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 976/1955] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:22.648496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceed853-8c69-49a5-872e-ffefa192bed1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:22.658720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceed853-8c69-49a5-872e-ffefa192bed1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:22.663764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd280c-71ca-42e7-bcb0-277c6c30fb28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:22.664633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd280c-71ca-42e7-bcb0-277c6c30fb28 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:22.665059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd280c-71ca-42e7-bcb0-277c6c30fb28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:22.671362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd280c-71ca-42e7-bcb0-277c6c30fb28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:22.772909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd280c-71ca-42e7-bcb0-277c6c30fb28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:22.774707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd280c-71ca-42e7-bcb0-277c6c30fb28 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:22.802338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 980/1956] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:26.631785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb355758-be7d-4603-a90c-572fd866c206 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:26.640294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb355758-be7d-4603-a90c-572fd866c206 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:26.643982 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79075c-cc9f-4ce5-8e53-71b5d736813b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:26.644601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79075c-cc9f-4ce5-8e53-71b5d736813b service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:26.644877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79075c-cc9f-4ce5-8e53-71b5d736813b service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:26.645150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79075c-cc9f-4ce5-8e53-71b5d736813b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:26.654026 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79075c-cc9f-4ce5-8e53-71b5d736813b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:26.655523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79075c-cc9f-4ce5-8e53-71b5d736813b service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:26.667042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 977/1957] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:32.782233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=70 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:36.661623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=29 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:37.060135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd280c-71ca-42e7-bcb0-277c6c30fb28 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:37.139017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd280c-71ca-42e7-bcb0-277c6c30fb28 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:37.143924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:37.144571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:37.144847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:37.145118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] PATH_INFO: `/v3/users/09dd051313e045338e9223836d6f6687` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:37.146296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dd051313e045338e9223836d6f6687)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:37.148327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:37.211368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dd051313e045338e9223836d6f6687'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.220618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dd051313e045338e9223836d6f6687'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.234215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dd051313e045338e9223836d6f6687'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.234794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dd051313e045338e9223836d6f6687'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.246561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dd051313e045338e9223836d6f6687'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.253009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 981/1958] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:37 2022] DELETE /identity/v3/users/09dd051313e045338e9223836d6f6687 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:37.257697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e01e2-ad2d-4be1-897c-da1f02ca9a00 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:37.257971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e01e2-ad2d-4be1-897c-da1f02ca9a00 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:37.258243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e01e2-ad2d-4be1-897c-da1f02ca9a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:37.278830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-438e01e2-ad2d-4be1-897c-da1f02ca9a00 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:37.280073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-438e01e2-ad2d-4be1-897c-da1f02ca9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:37.340789 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 978/1959] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:37.351793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:37.353311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:37.415034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a42c48-3a7a-4623-963e-15ecb153e76c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:37.418735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec0c4f-63cd-4e37-9f21-1e2b9074dea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:37.419331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec0c4f-63cd-4e37-9f21-1e2b9074dea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:37.419611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec0c4f-63cd-4e37-9f21-1e2b9074dea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:37.419894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec0c4f-63cd-4e37-9f21-1e2b9074dea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:37.432949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec0c4f-63cd-4e37-9f21-1e2b9074dea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:37.434461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec0c4f-63cd-4e37-9f21-1e2b9074dea3 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:37.444855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 982/1960] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:37.792829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e01e2-ad2d-4be1-897c-da1f02ca9a00 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:37.794702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-438e01e2-ad2d-4be1-897c-da1f02ca9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:37.827007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e01e2-ad2d-4be1-897c-da1f02ca9a00 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:37.833571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:37.834246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:37.834555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:37.834831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] PATH_INFO: `/v3/projects/cbd05b8a616a4323a73535ac6db4b067` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:37.837204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd05b8a616a4323a73535ac6db4b067)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:37.841272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:37.904380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd05b8a616a4323a73535ac6db4b067', 'request_id': 'req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.913114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd05b8a616a4323a73535ac6db4b067', 'request_id': 'req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.920097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd05b8a616a4323a73535ac6db4b067', 'request_id': 'req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.933300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] The token cache is being invalidate because project cbd05b8a616a4323a73535ac6db4b067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:37.933599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.934327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:37.935996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 979/1961] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:37 2022] DELETE /identity/v3/projects/cbd05b8a616a4323a73535ac6db4b067 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:37.940051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec0c4f-63cd-4e37-9f21-1e2b9074dea3 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:37.950447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec0c4f-63cd-4e37-9f21-1e2b9074dea3 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:37.969776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:38.012181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:38.012967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:38.013252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:38.013560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] PATH_INFO: `/v3/users/fd2d87e179934b48badfd58a99e8d712` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:38.014955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2d87e179934b48badfd58a99e8d712)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:38.016942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:38.065746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2d87e179934b48badfd58a99e8d712'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.074176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2d87e179934b48badfd58a99e8d712'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.087327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2d87e179934b48badfd58a99e8d712'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.088246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2d87e179934b48badfd58a99e8d712'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.095443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2d87e179934b48badfd58a99e8d712'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.102343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 983/1962] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:37 2022] DELETE /identity/v3/users/fd2d87e179934b48badfd58a99e8d712 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:38.510654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:38.512159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:38.525746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc3a4e-f6e6-4b4b-8282-1e4390059ada admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:38.588456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:38.589143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:38.589412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:38.589686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] PATH_INFO: `/v3/projects/31b39f5719e04844bb0fc36ebcc2b0ac` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:38.591174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b39f5719e04844bb0fc36ebcc2b0ac)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:38.593109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:38.626190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:38.648196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b39f5719e04844bb0fc36ebcc2b0ac', 'request_id': 'req-c87927d4-a24a-491b-a3c3-44d83c959f96'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.655466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b39f5719e04844bb0fc36ebcc2b0ac', 'request_id': 'req-c87927d4-a24a-491b-a3c3-44d83c959f96'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.663085 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b39f5719e04844bb0fc36ebcc2b0ac', 'request_id': 'req-c87927d4-a24a-491b-a3c3-44d83c959f96'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.674687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] The token cache is being invalidate because project 31b39f5719e04844bb0fc36ebcc2b0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:38.675146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.675818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.678929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 980/1963] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:38 2022] DELETE /identity/v3/projects/31b39f5719e04844bb0fc36ebcc2b0ac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:38.682214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:38.683706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:38.698587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd1537-d3e2-45d3-bf9e-e99814143795 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:38.846766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:38.847476 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:38.847763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:38.848049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] PATH_INFO: `/v3/users/7956afefc9464d3a9458e2861407e49e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:38.849517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7956afefc9464d3a9458e2861407e49e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:38.851513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:38.932163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:38.935587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7956afefc9464d3a9458e2861407e49e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.948315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7956afefc9464d3a9458e2861407e49e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.968765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7956afefc9464d3a9458e2861407e49e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.969469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7956afefc9464d3a9458e2861407e49e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.978311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f3df5f4c-c7bc-4a9d-a393-3af02d854db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7956afefc9464d3a9458e2861407e49e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:38.985955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 984/1964] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:38 2022] DELETE /identity/v3/users/7956afefc9464d3a9458e2861407e49e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:50:39.403315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:39.404888 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:39.431468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87927d4-a24a-491b-a3c3-44d83c959f96 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:39.532262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:39.532871 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:39.533146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:39.533416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] PATH_INFO: `/v3/projects/71f1abf53f994e5b8bf6094321641ea3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:39.534702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f1abf53f994e5b8bf6094321641ea3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:39.536684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:39.597450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f1abf53f994e5b8bf6094321641ea3', 'request_id': 'req-2b931d98-212b-449c-8b8d-b5553e849877'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:39.606763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f1abf53f994e5b8bf6094321641ea3', 'request_id': 'req-2b931d98-212b-449c-8b8d-b5553e849877'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:39.616029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f1abf53f994e5b8bf6094321641ea3', 'request_id': 'req-2b931d98-212b-449c-8b8d-b5553e849877'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:39.633883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] The token cache is being invalidate because project 71f1abf53f994e5b8bf6094321641ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:39.634176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:39.634856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b931d98-212b-449c-8b8d-b5553e849877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:39.636727 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 981/1965] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:39 2022] DELETE /identity/v3/projects/71f1abf53f994e5b8bf6094321641ea3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:39.642305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da777-c7c9-47bc-afbc-17ae16245a75 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:39.642784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da777-c7c9-47bc-afbc-17ae16245a75 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:39.643052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da777-c7c9-47bc-afbc-17ae16245a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:39.664917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-274da777-c7c9-47bc-afbc-17ae16245a75 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:39.666287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-274da777-c7c9-47bc-afbc-17ae16245a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:39.731547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 985/1966] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:39.741437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543777b-2266-4c48-b217-243ba7b2452f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:39.741753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543777b-2266-4c48-b217-243ba7b2452f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:39.742069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543777b-2266-4c48-b217-243ba7b2452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:39.762898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7543777b-2266-4c48-b217-243ba7b2452f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:39.764150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7543777b-2266-4c48-b217-243ba7b2452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:39.772349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 982/1967] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:39.777282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da777-c7c9-47bc-afbc-17ae16245a75 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:39.787584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da777-c7c9-47bc-afbc-17ae16245a75 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:39.793112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2eaf6-e9bd-4ad6-8015-f39384e2c902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:39.793743 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2eaf6-e9bd-4ad6-8015-f39384e2c902 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:39.794213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2eaf6-e9bd-4ad6-8015-f39384e2c902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:39.794664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2eaf6-e9bd-4ad6-8015-f39384e2c902 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:39.795540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2eaf6-e9bd-4ad6-8015-f39384e2c902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:39.796181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2eaf6-e9bd-4ad6-8015-f39384e2c902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:39.797726 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2eaf6-e9bd-4ad6-8015-f39384e2c902 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:39.811481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 986/1968] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:50:39.816890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543777b-2266-4c48-b217-243ba7b2452f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:39.826318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543777b-2266-4c48-b217-243ba7b2452f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:39.830978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbefaf-e0b6-476f-9d36-fe0ce240a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:39.831597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbefaf-e0b6-476f-9d36-fe0ce240a457 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:39.831877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbefaf-e0b6-476f-9d36-fe0ce240a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:39.832149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbefaf-e0b6-476f-9d36-fe0ce240a457 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:39.832833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbefaf-e0b6-476f-9d36-fe0ce240a457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:39.834736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbefaf-e0b6-476f-9d36-fe0ce240a457 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:39.863917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 983/1969] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:39 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:39.868766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2eaf6-e9bd-4ad6-8015-f39384e2c902 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:39.881095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2eaf6-e9bd-4ad6-8015-f39384e2c902 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:39.955337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2d57b-5abc-4a5b-b6ce-db55c5172a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:39.958926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2d57b-5abc-4a5b-b6ce-db55c5172a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:39.959313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2d57b-5abc-4a5b-b6ce-db55c5172a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:39.959705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2d57b-5abc-4a5b-b6ce-db55c5172a9a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:39.960520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2d57b-5abc-4a5b-b6ce-db55c5172a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:39.963647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2d57b-5abc-4a5b-b6ce-db55c5172a9a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:39.990928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 987/1970] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:39 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:39.995116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbefaf-e0b6-476f-9d36-fe0ce240a457 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:40.011483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbefaf-e0b6-476f-9d36-fe0ce240a457 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:40.017324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f2c6e-b7ee-48e3-965c-755718a560ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:40.018136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f2c6e-b7ee-48e3-965c-755718a560ed admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:40.018765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f2c6e-b7ee-48e3-965c-755718a560ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:40.019048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f2c6e-b7ee-48e3-965c-755718a560ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:40.020587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f2c6e-b7ee-48e3-965c-755718a560ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:40.022747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f2c6e-b7ee-48e3-965c-755718a560ed admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:40.035475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 984/1971] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:40.039681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2d57b-5abc-4a5b-b6ce-db55c5172a9a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:40.050828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2d57b-5abc-4a5b-b6ce-db55c5172a9a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:40.056192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524c04-641d-454c-96c5-c6ae85194597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:40.056915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524c04-641d-454c-96c5-c6ae85194597 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:40.057289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524c04-641d-454c-96c5-c6ae85194597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:40.057679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524c04-641d-454c-96c5-c6ae85194597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:40.058479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d524c04-641d-454c-96c5-c6ae85194597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:40.060233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d524c04-641d-454c-96c5-c6ae85194597 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:40.074332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 988/1972] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:50:40.079144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f2c6e-b7ee-48e3-965c-755718a560ed admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:40.088516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:40.093523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f2c6e-b7ee-48e3-965c-755718a560ed admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:40.100412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c88f6-6d52-46e7-aa45-c451059752a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:40.101355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c88f6-6d52-46e7-aa45-c451059752a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:40.101660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c88f6-6d52-46e7-aa45-c451059752a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:40.102009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c88f6-6d52-46e7-aa45-c451059752a0 admin admin] PATH_INFO: `/v3/projects/2780732d29a640458427891ef5c81557/users/39b2a8b2b8834483839beac0f1dbef25/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:40.128750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c88f6-6d52-46e7-aa45-c451059752a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2780732d29a640458427891ef5c81557, user_id=39b2a8b2b8834483839beac0f1dbef25, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:40.131620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c88f6-6d52-46e7-aa45-c451059752a0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:40.154390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 985/1973] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:40 2022] PUT /identity/v3/projects/2780732d29a640458427891ef5c81557/users/39b2a8b2b8834483839beac0f1dbef25/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:50:40.165092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519c86-8720-49ef-8624-2954d373043c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:40.165307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519c86-8720-49ef-8624-2954d373043c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:40.165582 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519c86-8720-49ef-8624-2954d373043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:40.201935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cb519c86-8720-49ef-8624-2954d373043c None None] MFA Rules not processed for user `39b2a8b2b8834483839beac0f1dbef25`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:40.203562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cb519c86-8720-49ef-8624-2954d373043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:40.222913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:40.293608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 989/1974] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:40.306833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c88f6-6d52-46e7-aa45-c451059752a0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:40.308813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ee0c88f6-6d52-46e7-aa45-c451059752a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:40.403145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c88f6-6d52-46e7-aa45-c451059752a0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:40.436361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58179c7c-8f3b-4930-bb3b-bf5ae73cc756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:40.437003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58179c7c-8f3b-4930-bb3b-bf5ae73cc756 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:40.437393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58179c7c-8f3b-4930-bb3b-bf5ae73cc756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:40.437726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58179c7c-8f3b-4930-bb3b-bf5ae73cc756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:40.449359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58179c7c-8f3b-4930-bb3b-bf5ae73cc756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:40.451264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58179c7c-8f3b-4930-bb3b-bf5ae73cc756 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:40.465108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 986/1975] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:48.480627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519c86-8720-49ef-8624-2954d373043c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:48.543368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519c86-8720-49ef-8624-2954d373043c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:48.547956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:48.548600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:48.548888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:48.549166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] PATH_INFO: `/v3/users/39b2a8b2b8834483839beac0f1dbef25` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:48.550934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b2a8b2b8834483839beac0f1dbef25)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:48.552870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:48.598683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b2a8b2b8834483839beac0f1dbef25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:48.606274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b2a8b2b8834483839beac0f1dbef25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:48.618669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b2a8b2b8834483839beac0f1dbef25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:48.619355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b2a8b2b8834483839beac0f1dbef25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:48.626556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b2a8b2b8834483839beac0f1dbef25'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:48.632489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 990/1976] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:48 2022] DELETE /identity/v3/users/39b2a8b2b8834483839beac0f1dbef25 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:48.637281 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a59d4-2c1c-4c66-8a64-5ebb7dce541a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:48.637790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a59d4-2c1c-4c66-8a64-5ebb7dce541a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:48.637884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a59d4-2c1c-4c66-8a64-5ebb7dce541a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:48.656404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0c6a59d4-2c1c-4c66-8a64-5ebb7dce541a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:48.657624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0c6a59d4-2c1c-4c66-8a64-5ebb7dce541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:48.714262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 987/1977] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:48.725274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:48.726676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:48.765953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:48.786388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2779271-2296-443f-8f54-1b1d1382dabf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:48.790990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4de86-064b-4fab-a26c-a7c6dfada0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:48.791611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4de86-064b-4fab-a26c-a7c6dfada0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:48.791960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4de86-064b-4fab-a26c-a7c6dfada0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:48.792152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4de86-064b-4fab-a26c-a7c6dfada0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:48.804654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4de86-064b-4fab-a26c-a7c6dfada0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:48.806193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4de86-064b-4fab-a26c-a7c6dfada0a7 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:48.817683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 991/1978] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:49.196293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a59d4-2c1c-4c66-8a64-5ebb7dce541a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:49.197804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0c6a59d4-2c1c-4c66-8a64-5ebb7dce541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:49.216677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a59d4-2c1c-4c66-8a64-5ebb7dce541a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:49.229359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:49.229575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.230121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.230396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] PATH_INFO: `/v3/projects/2780732d29a640458427891ef5c81557` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.232213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2780732d29a640458427891ef5c81557)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:49.234217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:49.288474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2780732d29a640458427891ef5c81557', 'request_id': 'req-b3197c68-1646-40f4-81e5-0646b578b3c3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:49.295839 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2780732d29a640458427891ef5c81557', 'request_id': 'req-b3197c68-1646-40f4-81e5-0646b578b3c3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:49.303624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2780732d29a640458427891ef5c81557', 'request_id': 'req-b3197c68-1646-40f4-81e5-0646b578b3c3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:49.315437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] The token cache is being invalidate because project 2780732d29a640458427891ef5c81557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:49.315725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:49.316366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b3197c68-1646-40f4-81e5-0646b578b3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:49.318099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 988/1979] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:49 2022] DELETE /identity/v3/projects/2780732d29a640458427891ef5c81557 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:49.322789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040c2ab-5cd9-4205-969d-7ed982ad9f8b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.323316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040c2ab-5cd9-4205-969d-7ed982ad9f8b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.323623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040c2ab-5cd9-4205-969d-7ed982ad9f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.343928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1040c2ab-5cd9-4205-969d-7ed982ad9f8b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:49.345400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1040c2ab-5cd9-4205-969d-7ed982ad9f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:49.451282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 992/1980] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:49.455881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad066-98ad-4f36-94c6-282ccc9aa81e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.456170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad066-98ad-4f36-94c6-282ccc9aa81e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.456449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad066-98ad-4f36-94c6-282ccc9aa81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.473296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:49.495713 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b43ad066-98ad-4f36-94c6-282ccc9aa81e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:49.496001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b43ad066-98ad-4f36-94c6-282ccc9aa81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:49.510819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040c2ab-5cd9-4205-969d-7ed982ad9f8b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:49.516969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 989/1981] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:49.524787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040c2ab-5cd9-4205-969d-7ed982ad9f8b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:49.546949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d41c66-e7a3-44a6-a8c5-42a4760a129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:49.546949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d41c66-e7a3-44a6-a8c5-42a4760a129d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.546949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d41c66-e7a3-44a6-a8c5-42a4760a129d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.546949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d41c66-e7a3-44a6-a8c5-42a4760a129d admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.547355 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d41c66-e7a3-44a6-a8c5-42a4760a129d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:49.547493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d41c66-e7a3-44a6-a8c5-42a4760a129d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:49.549013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d41c66-e7a3-44a6-a8c5-42a4760a129d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:49.562000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 993/1982] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:50:49.566499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ad066-98ad-4f36-94c6-282ccc9aa81e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:49.577293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ad066-98ad-4f36-94c6-282ccc9aa81e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:49.582915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200b17a-08bf-4659-91c3-b1a7ce52035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:49.583568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200b17a-08bf-4659-91c3-b1a7ce52035b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.583851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200b17a-08bf-4659-91c3-b1a7ce52035b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.584149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200b17a-08bf-4659-91c3-b1a7ce52035b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.584849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200b17a-08bf-4659-91c3-b1a7ce52035b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:49.586764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200b17a-08bf-4659-91c3-b1a7ce52035b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:49.617619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 990/1983] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:49 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:49.622216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d41c66-e7a3-44a6-a8c5-42a4760a129d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:49.633640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d41c66-e7a3-44a6-a8c5-42a4760a129d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:49.690665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7c5b-2e57-4610-b2f9-0b0b21704319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:49.691230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7c5b-2e57-4610-b2f9-0b0b21704319 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.691515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7c5b-2e57-4610-b2f9-0b0b21704319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.691790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7c5b-2e57-4610-b2f9-0b0b21704319 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.692468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b7c5b-2e57-4610-b2f9-0b0b21704319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:49.694487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b7c5b-2e57-4610-b2f9-0b0b21704319 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:49.715464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 994/1984] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:49 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:50:49.719739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200b17a-08bf-4659-91c3-b1a7ce52035b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:49.730819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200b17a-08bf-4659-91c3-b1a7ce52035b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:49.735604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2cd82-4efc-4d58-9d35-3ae9e48a089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:49.736219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2cd82-4efc-4d58-9d35-3ae9e48a089b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.736501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2cd82-4efc-4d58-9d35-3ae9e48a089b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.736820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2cd82-4efc-4d58-9d35-3ae9e48a089b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.737559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2cd82-4efc-4d58-9d35-3ae9e48a089b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:49.739171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2cd82-4efc-4d58-9d35-3ae9e48a089b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:49.749057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 991/1985] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:49.752998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7c5b-2e57-4610-b2f9-0b0b21704319 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:49.762832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7c5b-2e57-4610-b2f9-0b0b21704319 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:49.767557 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d8569-7c9b-44e4-a093-2e5c305caba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:49.768706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8569-7c9b-44e4-a093-2e5c305caba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.768986 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8569-7c9b-44e4-a093-2e5c305caba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.769256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d8569-7c9b-44e4-a093-2e5c305caba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.769945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d8569-7c9b-44e4-a093-2e5c305caba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:49.771578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d8569-7c9b-44e4-a093-2e5c305caba4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:49.782472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 995/1986] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:49.786706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2cd82-4efc-4d58-9d35-3ae9e48a089b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:49.796720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2cd82-4efc-4d58-9d35-3ae9e48a089b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:49.801957 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06101b68-5592-4575-a210-fbecae24c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:49.802635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06101b68-5592-4575-a210-fbecae24c9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.802977 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06101b68-5592-4575-a210-fbecae24c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.803257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06101b68-5592-4575-a210-fbecae24c9f4 admin admin] PATH_INFO: `/v3/projects/885070b1ca554f888588bc0661b6e60e/users/c15dd07d86ec45f8ab90abedf599201c/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.818505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06101b68-5592-4575-a210-fbecae24c9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=885070b1ca554f888588bc0661b6e60e, user_id=c15dd07d86ec45f8ab90abedf599201c, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:49.821202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06101b68-5592-4575-a210-fbecae24c9f4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:49.834166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 992/1987] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:49 2022] PUT /identity/v3/projects/885070b1ca554f888588bc0661b6e60e/users/c15dd07d86ec45f8ab90abedf599201c/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:50:49.844817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227eabb-b480-4562-8e87-7f4805574f0f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:49.845103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227eabb-b480-4562-8e87-7f4805574f0f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:49.845397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227eabb-b480-4562-8e87-7f4805574f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:49.873956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e227eabb-b480-4562-8e87-7f4805574f0f None None] MFA Rules not processed for user `c15dd07d86ec45f8ab90abedf599201c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:49.875233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e227eabb-b480-4562-8e87-7f4805574f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:49.907798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:49.941451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 996/1988] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:49.952067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06101b68-5592-4575-a210-fbecae24c9f4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:49.954435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-06101b68-5592-4575-a210-fbecae24c9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:50.013019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06101b68-5592-4575-a210-fbecae24c9f4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:50.017197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016963-a873-4786-933a-8503dc0f3da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:50.017878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016963-a873-4786-933a-8503dc0f3da0 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:50.018282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016963-a873-4786-933a-8503dc0f3da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:50.018563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016963-a873-4786-933a-8503dc0f3da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:50.026991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016963-a873-4786-933a-8503dc0f3da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:50.028450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016963-a873-4786-933a-8503dc0f3da0 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:50.037912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 993/1989] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:51.439172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75491dee-f373-40e9-ae9a-608a65ee0e61 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:51.439679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75491dee-f373-40e9-ae9a-608a65ee0e61 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:51.440299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75491dee-f373-40e9-ae9a-608a65ee0e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:51.460522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-75491dee-f373-40e9-ae9a-608a65ee0e61 None None] MFA Rules not processed for user `c15dd07d86ec45f8ab90abedf599201c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:51.461727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-75491dee-f373-40e9-ae9a-608a65ee0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:51.474607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 997/1990] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:51.999105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016963-a873-4786-933a-8503dc0f3da0 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:52.004655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-44016963-a873-4786-933a-8503dc0f3da0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:52.085376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016963-a873-4786-933a-8503dc0f3da0 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:52.090375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:52.091062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:52.091378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:52.091647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] PATH_INFO: `/v3/users/fa938b9797eb4c6e989ef8dc53c16d98` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:52.092889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa938b9797eb4c6e989ef8dc53c16d98)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:52.094930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:52.153486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa938b9797eb4c6e989ef8dc53c16d98'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.155903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:52.190570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa938b9797eb4c6e989ef8dc53c16d98'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.191416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa938b9797eb4c6e989ef8dc53c16d98'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.201143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa938b9797eb4c6e989ef8dc53c16d98'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.203692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa938b9797eb4c6e989ef8dc53c16d98'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.234282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 994/1991] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:50:51 2022] DELETE /identity/v3/users/fa938b9797eb4c6e989ef8dc53c16d98 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:52.238753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440a454-959c-40e0-8292-93dc34f04298 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:52.239160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440a454-959c-40e0-8292-93dc34f04298 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:52.239752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440a454-959c-40e0-8292-93dc34f04298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:52.272718 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2440a454-959c-40e0-8292-93dc34f04298 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:52.274955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2440a454-959c-40e0-8292-93dc34f04298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:52.352308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 998/1992] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:50:52.365985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:52.368381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:52.446626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbbc73-2d49-4874-9647-1081697f0ca5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:52.450393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155a18e-b636-4c37-a464-6196f4bd1db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:52.451142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155a18e-b636-4c37-a464-6196f4bd1db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:52.451491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155a18e-b636-4c37-a464-6196f4bd1db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:52.451832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155a18e-b636-4c37-a464-6196f4bd1db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:52.462511 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155a18e-b636-4c37-a464-6196f4bd1db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:52.464299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155a18e-b636-4c37-a464-6196f4bd1db7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:52.474867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 995/1993] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:50:52.771262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440a454-959c-40e0-8292-93dc34f04298 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:52.777062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2440a454-959c-40e0-8292-93dc34f04298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:52.812812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440a454-959c-40e0-8292-93dc34f04298 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:52.819099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:52.820252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:52.820665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:52.820932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] PATH_INFO: `/v3/projects/f6174522ef16494d97d291911c561881` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:52.822230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6174522ef16494d97d291911c561881)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:52.824298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:52.891772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6174522ef16494d97d291911c561881', 'request_id': 'req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.904075 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6174522ef16494d97d291911c561881', 'request_id': 'req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.911364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6174522ef16494d97d291911c561881', 'request_id': 'req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.924693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] The token cache is being invalidate because project f6174522ef16494d97d291911c561881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:50:52.924983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.925643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-311b4f82-7b88-4d55-b5e6-c49f3237d7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:50:52.927462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 999/1994] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:50:52 2022] DELETE /identity/v3/projects/f6174522ef16494d97d291911c561881 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:52.932150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec83753-06ee-41da-9d50-20bf78e091ca None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:52.932443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec83753-06ee-41da-9d50-20bf78e091ca None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:52.932723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec83753-06ee-41da-9d50-20bf78e091ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:52.959410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eec83753-06ee-41da-9d50-20bf78e091ca None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:52.960744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eec83753-06ee-41da-9d50-20bf78e091ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:53.030510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 996/1995] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:53.039411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cb20-6d3a-4b1e-a4af-d3ba1bba3cd2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:53.040462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cb20-6d3a-4b1e-a4af-d3ba1bba3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:53.040749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cb20-6d3a-4b1e-a4af-d3ba1bba3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:53.061667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-58c0cb20-6d3a-4b1e-a4af-d3ba1bba3cd2 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:53.062950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-58c0cb20-6d3a-4b1e-a4af-d3ba1bba3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:53.071713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1000/1996] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:53.076530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec83753-06ee-41da-9d50-20bf78e091ca None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:53.087710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec83753-06ee-41da-9d50-20bf78e091ca None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:53.092580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015514-1f36-4e58-8a98-ca737b92a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:53.093318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015514-1f36-4e58-8a98-ca737b92a030 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:53.093676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015514-1f36-4e58-8a98-ca737b92a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:53.093942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015514-1f36-4e58-8a98-ca737b92a030 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:53.094790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b015514-1f36-4e58-8a98-ca737b92a030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:50:53.095164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b015514-1f36-4e58-8a98-ca737b92a030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:53.097483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b015514-1f36-4e58-8a98-ca737b92a030 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:53.110019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 997/1997] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 07:50:53.114585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0cb20-6d3a-4b1e-a4af-d3ba1bba3cd2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:53.124130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0cb20-6d3a-4b1e-a4af-d3ba1bba3cd2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:53.129836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dabe91-68be-4793-9740-9333d5477b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:53.130467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dabe91-68be-4793-9740-9333d5477b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:53.130747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dabe91-68be-4793-9740-9333d5477b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:53.131063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dabe91-68be-4793-9740-9333d5477b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:53.131734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dabe91-68be-4793-9740-9333d5477b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:53.133642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dabe91-68be-4793-9740-9333d5477b90 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:53.162388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1001/1998] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:50:53 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:53.166729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015514-1f36-4e58-8a98-ca737b92a030 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:53.178233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015514-1f36-4e58-8a98-ca737b92a030 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:53.235402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:53.244657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3f9ed-6fa5-4da1-b0bb-106a7c2f3b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:53.245433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3f9ed-6fa5-4da1-b0bb-106a7c2f3b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:53.245743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3f9ed-6fa5-4da1-b0bb-106a7c2f3b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:53.246349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3f9ed-6fa5-4da1-b0bb-106a7c2f3b6d admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:53.247239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3f9ed-6fa5-4da1-b0bb-106a7c2f3b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:53.249356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3f9ed-6fa5-4da1-b0bb-106a7c2f3b6d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:53.278762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 998/1999] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:50:53 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:50:53.280179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dabe91-68be-4793-9740-9333d5477b90 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:53.292061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dabe91-68be-4793-9740-9333d5477b90 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:53.298584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a357e1-6488-4114-849b-ba11a0fdcced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:53.299657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a357e1-6488-4114-849b-ba11a0fdcced admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:53.300124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a357e1-6488-4114-849b-ba11a0fdcced admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:53.300594 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a357e1-6488-4114-849b-ba11a0fdcced admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:53.301406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a357e1-6488-4114-849b-ba11a0fdcced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:53.303982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a357e1-6488-4114-849b-ba11a0fdcced admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:53.323059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1002/2000] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:53.324295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3f9ed-6fa5-4da1-b0bb-106a7c2f3b6d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:53.339269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3f9ed-6fa5-4da1-b0bb-106a7c2f3b6d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:53.345600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3cb29-a73f-4cd6-8e1c-6628a2b0106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:53.347258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3cb29-a73f-4cd6-8e1c-6628a2b0106a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:53.347666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3cb29-a73f-4cd6-8e1c-6628a2b0106a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:53.348010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3cb29-a73f-4cd6-8e1c-6628a2b0106a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:53.349766 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3cb29-a73f-4cd6-8e1c-6628a2b0106a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:53.352217 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3cb29-a73f-4cd6-8e1c-6628a2b0106a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:53.392277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 999/2001] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:50:53.397370 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a357e1-6488-4114-849b-ba11a0fdcced admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:53.417894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a357e1-6488-4114-849b-ba11a0fdcced admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:53.440844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f1032-b61b-44b1-a13d-8c31abda1460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:53.442282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f1032-b61b-44b1-a13d-8c31abda1460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:53.442727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f1032-b61b-44b1-a13d-8c31abda1460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:53.443189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f1032-b61b-44b1-a13d-8c31abda1460 admin admin] PATH_INFO: `/v3/projects/6e19f3057a3b49f98f53e9ce02f32b4c/users/44e2fdcb72da4928b0e7d2fb02f8634a/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:53.454741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:53.463344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f1032-b61b-44b1-a13d-8c31abda1460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e19f3057a3b49f98f53e9ce02f32b4c, user_id=44e2fdcb72da4928b0e7d2fb02f8634a, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:53.477377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f1032-b61b-44b1-a13d-8c31abda1460 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:53.495766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1003/2002] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:50:53 2022] PUT /identity/v3/projects/6e19f3057a3b49f98f53e9ce02f32b4c/users/44e2fdcb72da4928b0e7d2fb02f8634a/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:50:53.507177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd7762-88ee-43cd-95bd-d287a68b531f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:53.507742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd7762-88ee-43cd-95bd-d287a68b531f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:53.508086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd7762-88ee-43cd-95bd-d287a68b531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:53.577472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d1fd7762-88ee-43cd-95bd-d287a68b531f None None] MFA Rules not processed for user `44e2fdcb72da4928b0e7d2fb02f8634a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:50:53.578920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d1fd7762-88ee-43cd-95bd-d287a68b531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:53.675714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1000/2003] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:50:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:50:53.688752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f1032-b61b-44b1-a13d-8c31abda1460 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:50:53.691245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8f3f1032-b61b-44b1-a13d-8c31abda1460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:50:53.752199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f1032-b61b-44b1-a13d-8c31abda1460 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:50:53.755841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc03dc-f153-46f2-b5ee-1c678a8d7b2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7a3c5f6b9645fb8cd2a65cee4f37c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:50:53.756531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc03dc-f153-46f2-b5ee-1c678a8d7b2e service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:50:53.756819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc03dc-f153-46f2-b5ee-1c678a8d7b2e service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:50:53.757094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc03dc-f153-46f2-b5ee-1c678a8d7b2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:50:53.765783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc03dc-f153-46f2-b5ee-1c678a8d7b2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:50:53.767270 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc03dc-f153-46f2-b5ee-1c678a8d7b2e service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:50:53.776363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1004/2004] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:50:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:03.672678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:03.772341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:15.583843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd7762-88ee-43cd-95bd-d287a68b531f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:15.585472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d1fd7762-88ee-43cd-95bd-d287a68b531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:15.658910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd7762-88ee-43cd-95bd-d287a68b531f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:15.663337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:15.663990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:15.664290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:15.664565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] PATH_INFO: `/v3/users/e25c359062c04d74a443622b70e2541b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:15.665748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25c359062c04d74a443622b70e2541b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:15.667723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:15.713298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25c359062c04d74a443622b70e2541b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:15.726025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25c359062c04d74a443622b70e2541b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:15.726738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25c359062c04d74a443622b70e2541b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:15.735506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25c359062c04d74a443622b70e2541b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:15.736185 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25c359062c04d74a443622b70e2541b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:15.752248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1001/2005] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:51:15 2022] DELETE /identity/v3/users/e25c359062c04d74a443622b70e2541b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:15.757367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec245-c463-4d2c-8b50-d8a34de5461f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:15.758181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec245-c463-4d2c-8b50-d8a34de5461f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:15.758181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec245-c463-4d2c-8b50-d8a34de5461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:15.783831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-564ec245-c463-4d2c-8b50-d8a34de5461f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:15.785313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-564ec245-c463-4d2c-8b50-d8a34de5461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:15.847910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1005/2006] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:15.857963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:15.859454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:15.920651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83ebf-a6c6-426d-b2bb-6b1b2bfd31da admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:15.925387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad555f-5f4e-40bd-b178-81492b8032d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:15.926090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad555f-5f4e-40bd-b178-81492b8032d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:15.926374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad555f-5f4e-40bd-b178-81492b8032d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:15.926734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad555f-5f4e-40bd-b178-81492b8032d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:15.941266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad555f-5f4e-40bd-b178-81492b8032d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:15.942862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad555f-5f4e-40bd-b178-81492b8032d1 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:15.952552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1002/2007] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:16.327779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec245-c463-4d2c-8b50-d8a34de5461f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:16.329634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-564ec245-c463-4d2c-8b50-d8a34de5461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:16.355876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec245-c463-4d2c-8b50-d8a34de5461f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:16.362995 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:16.363654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:16.363933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:16.364210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] PATH_INFO: `/v3/projects/4f55c3636f8547f4a0b0cdede86c83bc` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:16.365385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f55c3636f8547f4a0b0cdede86c83bc)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:16.367390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:16.458938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f55c3636f8547f4a0b0cdede86c83bc', 'request_id': 'req-65b9d16d-0715-4252-a3de-714451d4dad7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:16.470277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f55c3636f8547f4a0b0cdede86c83bc', 'request_id': 'req-65b9d16d-0715-4252-a3de-714451d4dad7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:16.482603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f55c3636f8547f4a0b0cdede86c83bc', 'request_id': 'req-65b9d16d-0715-4252-a3de-714451d4dad7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:16.507343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] The token cache is being invalidate because project 4f55c3636f8547f4a0b0cdede86c83bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:51:16.507343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:16.507343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-65b9d16d-0715-4252-a3de-714451d4dad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:16.507343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1006/2008] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:51:16 2022] DELETE /identity/v3/projects/4f55c3636f8547f4a0b0cdede86c83bc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:16.510125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6a96-05bb-4da5-adc8-5c34c1f5570f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:16.510511 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6a96-05bb-4da5-adc8-5c34c1f5570f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:16.510932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6a96-05bb-4da5-adc8-5c34c1f5570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:16.539094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1b3c6a96-05bb-4da5-adc8-5c34c1f5570f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:16.541194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1b3c6a96-05bb-4da5-adc8-5c34c1f5570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:16.561145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:16.637540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1003/2009] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:16.645349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2702f-5b14-4125-b9f9-00bf8c608877 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:16.645658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2702f-5b14-4125-b9f9-00bf8c608877 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:16.646302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2702f-5b14-4125-b9f9-00bf8c608877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:16.668061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-29b2702f-5b14-4125-b9f9-00bf8c608877 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:16.669741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-29b2702f-5b14-4125-b9f9-00bf8c608877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:16.679675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1007/2010] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:16.683749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6a96-05bb-4da5-adc8-5c34c1f5570f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:16.695129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6a96-05bb-4da5-adc8-5c34c1f5570f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:16.704697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af61193-5d4e-4ac8-b279-4530929ee59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:16.705777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af61193-5d4e-4ac8-b279-4530929ee59a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:16.705777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af61193-5d4e-4ac8-b279-4530929ee59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:16.706108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af61193-5d4e-4ac8-b279-4530929ee59a admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:16.706947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af61193-5d4e-4ac8-b279-4530929ee59a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:51:16.707814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af61193-5d4e-4ac8-b279-4530929ee59a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:16.709573 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af61193-5d4e-4ac8-b279-4530929ee59a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:16.725571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1004/2011] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:51:16.726783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2702f-5b14-4125-b9f9-00bf8c608877 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:16.736484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2702f-5b14-4125-b9f9-00bf8c608877 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:16.741952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd6fe0-b21e-4f77-85b9-da084681cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:16.742927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd6fe0-b21e-4f77-85b9-da084681cfdd admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:16.743407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd6fe0-b21e-4f77-85b9-da084681cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:16.743763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd6fe0-b21e-4f77-85b9-da084681cfdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:16.744645 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd6fe0-b21e-4f77-85b9-da084681cfdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:16.746853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd6fe0-b21e-4f77-85b9-da084681cfdd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:16.777377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1008/2012] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:51:16 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:16.781505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af61193-5d4e-4ac8-b279-4530929ee59a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:16.791633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af61193-5d4e-4ac8-b279-4530929ee59a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:16.860357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22dbb5-a55b-401c-a89b-190aa4b38549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:16.860981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22dbb5-a55b-401c-a89b-190aa4b38549 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:16.861257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22dbb5-a55b-401c-a89b-190aa4b38549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:16.861527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22dbb5-a55b-401c-a89b-190aa4b38549 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:16.862203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22dbb5-a55b-401c-a89b-190aa4b38549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:16.864922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22dbb5-a55b-401c-a89b-190aa4b38549 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:16.887546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1005/2013] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:51:16 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:16.892114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd6fe0-b21e-4f77-85b9-da084681cfdd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:16.902699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd6fe0-b21e-4f77-85b9-da084681cfdd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:16.907387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadb696-ced6-4307-a75c-93dc90c79d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:16.907998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadb696-ced6-4307-a75c-93dc90c79d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:16.908277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadb696-ced6-4307-a75c-93dc90c79d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:16.908551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadb696-ced6-4307-a75c-93dc90c79d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:16.909782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadb696-ced6-4307-a75c-93dc90c79d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:16.911419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadb696-ced6-4307-a75c-93dc90c79d58 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:16.921296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1009/2014] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:16.926034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22dbb5-a55b-401c-a89b-190aa4b38549 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:16.936024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22dbb5-a55b-401c-a89b-190aa4b38549 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:16.940807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d38f6-6923-4589-b769-d9a997d0f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:16.941417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d38f6-6923-4589-b769-d9a997d0f1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:16.941693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d38f6-6923-4589-b769-d9a997d0f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:16.941971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d38f6-6923-4589-b769-d9a997d0f1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:16.942975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d38f6-6923-4589-b769-d9a997d0f1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:16.944293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d38f6-6923-4589-b769-d9a997d0f1fd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:16.955246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1006/2015] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:16.959637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadb696-ced6-4307-a75c-93dc90c79d58 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:16.969670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadb696-ced6-4307-a75c-93dc90c79d58 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:16.975759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c91ef-3efb-4f0f-a0be-9aaccfceab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:16.976455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c91ef-3efb-4f0f-a0be-9aaccfceab8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:16.976740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c91ef-3efb-4f0f-a0be-9aaccfceab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:16.977013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c91ef-3efb-4f0f-a0be-9aaccfceab8e admin admin] PATH_INFO: `/v3/projects/0d9f046545fb4f3c84949b3ada9d0b63/users/5917a86b7f5b441b8b229060a7981e58/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:16.992510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c91ef-3efb-4f0f-a0be-9aaccfceab8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9f046545fb4f3c84949b3ada9d0b63, user_id=5917a86b7f5b441b8b229060a7981e58, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:16.995225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c91ef-3efb-4f0f-a0be-9aaccfceab8e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:17.009443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1010/2016] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:16 2022] PUT /identity/v3/projects/0d9f046545fb4f3c84949b3ada9d0b63/users/5917a86b7f5b441b8b229060a7981e58/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:51:17.019699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00201042-1756-4fbf-9a00-399246428f83 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:17.019983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00201042-1756-4fbf-9a00-399246428f83 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:17.020257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00201042-1756-4fbf-9a00-399246428f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:17.052524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-00201042-1756-4fbf-9a00-399246428f83 None None] MFA Rules not processed for user `5917a86b7f5b441b8b229060a7981e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:17.053759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-00201042-1756-4fbf-9a00-399246428f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:17.120916 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1007/2017] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:17.136000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c91ef-3efb-4f0f-a0be-9aaccfceab8e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:17.137750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fa5c91ef-3efb-4f0f-a0be-9aaccfceab8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:17.165327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:17.208976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c91ef-3efb-4f0f-a0be-9aaccfceab8e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:17.212955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1516209-137a-4f5c-9b8a-c6d753a5a8b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:17.213613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1516209-137a-4f5c-9b8a-c6d753a5a8b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:17.213874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1516209-137a-4f5c-9b8a-c6d753a5a8b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:17.214145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1516209-137a-4f5c-9b8a-c6d753a5a8b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:17.224387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1516209-137a-4f5c-9b8a-c6d753a5a8b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:17.225824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1516209-137a-4f5c-9b8a-c6d753a5a8b3 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:17.235365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1011/2018] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:27.117073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:27.231443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=17 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:29.705836 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00201042-1756-4fbf-9a00-399246428f83 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:29.778775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00201042-1756-4fbf-9a00-399246428f83 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:29.785417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:29.786177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:29.786460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:29.786753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] PATH_INFO: `/v3/users/5917a86b7f5b441b8b229060a7981e58` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:29.788685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5917a86b7f5b441b8b229060a7981e58)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:29.791202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:29.852874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5917a86b7f5b441b8b229060a7981e58'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:29.873793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5917a86b7f5b441b8b229060a7981e58'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:29.876348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5917a86b7f5b441b8b229060a7981e58'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:29.892491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5917a86b7f5b441b8b229060a7981e58'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:29.893560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5917a86b7f5b441b8b229060a7981e58'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:29.913481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1008/2019] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:51:29 2022] DELETE /identity/v3/users/5917a86b7f5b441b8b229060a7981e58 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:29.918065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293832b-0b11-46b5-82db-d7079771c2aa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:29.918569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293832b-0b11-46b5-82db-d7079771c2aa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:29.918674 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293832b-0b11-46b5-82db-d7079771c2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:29.950177 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7293832b-0b11-46b5-82db-d7079771c2aa None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:29.951566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7293832b-0b11-46b5-82db-d7079771c2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:30.059436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1012/2020] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:30.070485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:30.072641 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:30.141528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aac00-14ce-4bd8-9237-ec663a8a8042 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:30.147435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594ea58-ac39-462b-be21-52b336760c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:30.148083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594ea58-ac39-462b-be21-52b336760c79 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:30.148365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594ea58-ac39-462b-be21-52b336760c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:30.148632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594ea58-ac39-462b-be21-52b336760c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:30.159715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594ea58-ac39-462b-be21-52b336760c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:30.161761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594ea58-ac39-462b-be21-52b336760c79 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:30.172676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1009/2021] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:30.494972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293832b-0b11-46b5-82db-d7079771c2aa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:30.496419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7293832b-0b11-46b5-82db-d7079771c2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:30.509044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293832b-0b11-46b5-82db-d7079771c2aa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:30.513836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:30.514486 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:30.514765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:30.515101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] PATH_INFO: `/v3/projects/0d9f046545fb4f3c84949b3ada9d0b63` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:30.516315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9f046545fb4f3c84949b3ada9d0b63)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:30.518203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:30.573721 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9f046545fb4f3c84949b3ada9d0b63', 'request_id': 'req-1776a638-7b9b-4b81-88cc-cfa50a048019'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:30.584081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9f046545fb4f3c84949b3ada9d0b63', 'request_id': 'req-1776a638-7b9b-4b81-88cc-cfa50a048019'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:30.591179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9f046545fb4f3c84949b3ada9d0b63', 'request_id': 'req-1776a638-7b9b-4b81-88cc-cfa50a048019'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:30.604006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] The token cache is being invalidate because project 0d9f046545fb4f3c84949b3ada9d0b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:51:30.604297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:30.604967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1776a638-7b9b-4b81-88cc-cfa50a048019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:30.606504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1013/2022] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:51:30 2022] DELETE /identity/v3/projects/0d9f046545fb4f3c84949b3ada9d0b63 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:30.611731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93f54d-89e4-4687-bd1e-d1599a85793a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:30.612118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93f54d-89e4-4687-bd1e-d1599a85793a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:30.612403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93f54d-89e4-4687-bd1e-d1599a85793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:30.633730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6b93f54d-89e4-4687-bd1e-d1599a85793a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:30.634997 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6b93f54d-89e4-4687-bd1e-d1599a85793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:30.652196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:30.696353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1010/2023] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:30.704094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc27da7-5b61-4e2c-b7a9-373277ca6685 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:30.704383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc27da7-5b61-4e2c-b7a9-373277ca6685 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:30.704660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc27da7-5b61-4e2c-b7a9-373277ca6685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:30.725416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ebc27da7-5b61-4e2c-b7a9-373277ca6685 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:30.726551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ebc27da7-5b61-4e2c-b7a9-373277ca6685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:30.734460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1014/2024] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:30.738717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93f54d-89e4-4687-bd1e-d1599a85793a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:30.748477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93f54d-89e4-4687-bd1e-d1599a85793a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:30.753115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dfb7f-4a19-40ce-9fa5-79a1ed6f8643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:30.753785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dfb7f-4a19-40ce-9fa5-79a1ed6f8643 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:30.754066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dfb7f-4a19-40ce-9fa5-79a1ed6f8643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:30.754337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dfb7f-4a19-40ce-9fa5-79a1ed6f8643 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:30.755076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dfb7f-4a19-40ce-9fa5-79a1ed6f8643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:51:30.755377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dfb7f-4a19-40ce-9fa5-79a1ed6f8643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:30.756965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dfb7f-4a19-40ce-9fa5-79a1ed6f8643 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:30.768500 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1011/2025] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:51:30.773269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc27da7-5b61-4e2c-b7a9-373277ca6685 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:30.782469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc27da7-5b61-4e2c-b7a9-373277ca6685 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:30.787766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a29ebb-f21f-4574-b7ac-156600284e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:30.788375 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a29ebb-f21f-4574-b7ac-156600284e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:30.788657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a29ebb-f21f-4574-b7ac-156600284e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:30.788930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a29ebb-f21f-4574-b7ac-156600284e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:30.789593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a29ebb-f21f-4574-b7ac-156600284e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:30.791558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a29ebb-f21f-4574-b7ac-156600284e02 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:30.824118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1015/2026] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:51:30 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:30.825297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dfb7f-4a19-40ce-9fa5-79a1ed6f8643 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:30.836911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dfb7f-4a19-40ce-9fa5-79a1ed6f8643 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:30.911050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee51f-dd98-4266-a955-7a4811a9c016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:30.911685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee51f-dd98-4266-a955-7a4811a9c016 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:30.911962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee51f-dd98-4266-a955-7a4811a9c016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:30.912237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee51f-dd98-4266-a955-7a4811a9c016 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:30.913030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ee51f-dd98-4266-a955-7a4811a9c016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:30.914860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ee51f-dd98-4266-a955-7a4811a9c016 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:30.936970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1012/2027] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:51:30 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:30.941015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a29ebb-f21f-4574-b7ac-156600284e02 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:30.952077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a29ebb-f21f-4574-b7ac-156600284e02 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:30.959778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff03e47-13c1-44d6-90d5-4bb056f29187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:30.960533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff03e47-13c1-44d6-90d5-4bb056f29187 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:30.960974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff03e47-13c1-44d6-90d5-4bb056f29187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:30.961437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff03e47-13c1-44d6-90d5-4bb056f29187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:30.962306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff03e47-13c1-44d6-90d5-4bb056f29187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:30.964102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff03e47-13c1-44d6-90d5-4bb056f29187 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:30.979465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1016/2028] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:30.982256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee51f-dd98-4266-a955-7a4811a9c016 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:30.993240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee51f-dd98-4266-a955-7a4811a9c016 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:30.997894 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2922f-d2b4-448b-8432-e915d25e1529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:30.998515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2922f-d2b4-448b-8432-e915d25e1529 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:30.998794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2922f-d2b4-448b-8432-e915d25e1529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:30.999122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2922f-d2b4-448b-8432-e915d25e1529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:30.999870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2922f-d2b4-448b-8432-e915d25e1529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:31.001480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2922f-d2b4-448b-8432-e915d25e1529 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:31.013655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1013/2029] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:31.018117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff03e47-13c1-44d6-90d5-4bb056f29187 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:31.029597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff03e47-13c1-44d6-90d5-4bb056f29187 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:31.034531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755be91-283f-466d-9126-0c22857e343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:31.035874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755be91-283f-466d-9126-0c22857e343e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:31.036154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755be91-283f-466d-9126-0c22857e343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:31.036424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755be91-283f-466d-9126-0c22857e343e admin admin] PATH_INFO: `/v3/projects/4271996d22bc4364a5554c0fbff0378b/users/08692d3eaab8431f8af3da2c1e098ec3/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:31.051978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755be91-283f-466d-9126-0c22857e343e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4271996d22bc4364a5554c0fbff0378b, user_id=08692d3eaab8431f8af3da2c1e098ec3, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:31.054788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755be91-283f-466d-9126-0c22857e343e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:31.070534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1017/2030] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:31 2022] PUT /identity/v3/projects/4271996d22bc4364a5554c0fbff0378b/users/08692d3eaab8431f8af3da2c1e098ec3/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:31.075779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883d64-a823-4dab-bdae-52fd37e922d9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:31.076340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883d64-a823-4dab-bdae-52fd37e922d9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:31.076623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883d64-a823-4dab-bdae-52fd37e922d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:31.099837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1c883d64-a823-4dab-bdae-52fd37e922d9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:31.101847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1c883d64-a823-4dab-bdae-52fd37e922d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:31.182647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1014/2031] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:31.193022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755be91-283f-466d-9126-0c22857e343e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:31.195345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7755be91-283f-466d-9126-0c22857e343e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:31.228319 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:31.268685 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755be91-283f-466d-9126-0c22857e343e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:31.276624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68ba9c-1c69-46e7-b22b-fa3432ca2a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:31.277247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68ba9c-1c69-46e7-b22b-fa3432ca2a27 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:31.277523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68ba9c-1c69-46e7-b22b-fa3432ca2a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:31.277798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68ba9c-1c69-46e7-b22b-fa3432ca2a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:31.289710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68ba9c-1c69-46e7-b22b-fa3432ca2a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:31.291326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68ba9c-1c69-46e7-b22b-fa3432ca2a27 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:31.304853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1018/2032] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:31.314812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78f83a-748e-49dd-a6c3-785c15a8ea0c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:31.315146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78f83a-748e-49dd-a6c3-785c15a8ea0c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:31.315424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78f83a-748e-49dd-a6c3-785c15a8ea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:31.336532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dc78f83a-748e-49dd-a6c3-785c15a8ea0c None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:31.338553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dc78f83a-748e-49dd-a6c3-785c15a8ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:31.371097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:31.412814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1015/2033] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:51:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:31.480860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68ba9c-1c69-46e7-b22b-fa3432ca2a27 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:31.482413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cc68ba9c-1c69-46e7-b22b-fa3432ca2a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:31.579894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68ba9c-1c69-46e7-b22b-fa3432ca2a27 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:31.588280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a9b2d-a41a-40aa-ad38-c5c466ef4aff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:31.589342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a9b2d-a41a-40aa-ad38-c5c466ef4aff service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:31.589643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a9b2d-a41a-40aa-ad38-c5c466ef4aff service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:31.589898 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a9b2d-a41a-40aa-ad38-c5c466ef4aff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:31.599663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a9b2d-a41a-40aa-ad38-c5c466ef4aff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:31.601334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a9b2d-a41a-40aa-ad38-c5c466ef4aff service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:31.611716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1019/2034] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:51:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:51:32.576549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d666-e95c-40d2-9666-b85b7a33a8ad None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:32.577529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d666-e95c-40d2-9666-b85b7a33a8ad None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:32.577981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d666-e95c-40d2-9666-b85b7a33a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:32.606284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5c00d666-e95c-40d2-9666-b85b7a33a8ad None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:32.607587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5c00d666-e95c-40d2-9666-b85b7a33a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:32.623020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1016/2035] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 27 07:51:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:32.642773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a9b2d-a41a-40aa-ad38-c5c466ef4aff service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:32.664797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a9b2d-a41a-40aa-ad38-c5c466ef4aff service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:32.671364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f4765-2be6-4089-b9ad-4b5be92dfcbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:32.672525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f4765-2be6-4089-b9ad-4b5be92dfcbc service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:32.672959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f4765-2be6-4089-b9ad-4b5be92dfcbc service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:32.673379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f4765-2be6-4089-b9ad-4b5be92dfcbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:32.683153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f4765-2be6-4089-b9ad-4b5be92dfcbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:32.684993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f4765-2be6-4089-b9ad-4b5be92dfcbc service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:32.704082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1020/2036] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:51:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 07:51:33.069893 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89970334-708e-43e9-b402-da74cb5b60c9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:33.070431 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89970334-708e-43e9-b402-da74cb5b60c9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:33.070704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89970334-708e-43e9-b402-da74cb5b60c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:33.099938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-89970334-708e-43e9-b402-da74cb5b60c9 None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:33.101238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-89970334-708e-43e9-b402-da74cb5b60c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:33.115601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1017/2037] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:51:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:33.133962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f4765-2be6-4089-b9ad-4b5be92dfcbc service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:33.150506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f4765-2be6-4089-b9ad-4b5be92dfcbc service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:33.168095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537eaf3-1edc-4532-b1a6-d8389f3828fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:33.168875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537eaf3-1edc-4532-b1a6-d8389f3828fb service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:33.169183 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537eaf3-1edc-4532-b1a6-d8389f3828fb service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:33.169493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537eaf3-1edc-4532-b1a6-d8389f3828fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:33.182126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537eaf3-1edc-4532-b1a6-d8389f3828fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:33.206730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537eaf3-1edc-4532-b1a6-d8389f3828fb service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:33.230304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1021/2038] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:51:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:51:33.754554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab2ad-6df9-4723-b9a5-5c72591b98ee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:33.755089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab2ad-6df9-4723-b9a5-5c72591b98ee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:33.755204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab2ad-6df9-4723-b9a5-5c72591b98ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:33.786336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-389ab2ad-6df9-4723-b9a5-5c72591b98ee None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:33.788608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-389ab2ad-6df9-4723-b9a5-5c72591b98ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:33.796882 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1018/2039] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 27 07:51:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:33.813474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537eaf3-1edc-4532-b1a6-d8389f3828fb service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:33.827541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537eaf3-1edc-4532-b1a6-d8389f3828fb service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:33.833972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd2e3-ab5e-45c2-bc10-9899c49c33a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:33.834716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd2e3-ab5e-45c2-bc10-9899c49c33a5 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:33.835307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd2e3-ab5e-45c2-bc10-9899c49c33a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:33.835695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd2e3-ab5e-45c2-bc10-9899c49c33a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:33.847551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd2e3-ab5e-45c2-bc10-9899c49c33a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:33.849952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd2e3-ab5e-45c2-bc10-9899c49c33a5 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:33.860699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1022/2040] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:51:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:51:37.187069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf01a49-7c0e-4266-92e7-2f54aaaa3786 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:37.188124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf01a49-7c0e-4266-92e7-2f54aaaa3786 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:37.188498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf01a49-7c0e-4266-92e7-2f54aaaa3786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:37.240687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3bf01a49-7c0e-4266-92e7-2f54aaaa3786 None None] MFA Rules not processed for user `08692d3eaab8431f8af3da2c1e098ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:37.242317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3bf01a49-7c0e-4266-92e7-2f54aaaa3786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:37.364194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1019/2041] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:37.366144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd2e3-ab5e-45c2-bc10-9899c49c33a5 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:37.398422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd2e3-ab5e-45c2-bc10-9899c49c33a5 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:37.407705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a2d77-9172-46a1-a4a3-6f9ec0133431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:37.412817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2d77-9172-46a1-a4a3-6f9ec0133431 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:37.413453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2d77-9172-46a1-a4a3-6f9ec0133431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:37.413868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2d77-9172-46a1-a4a3-6f9ec0133431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:37.415772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a2d77-9172-46a1-a4a3-6f9ec0133431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:37.417454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a2d77-9172-46a1-a4a3-6f9ec0133431 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:37.513807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1023/2042] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:51:37 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:37.518486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf01a49-7c0e-4266-92e7-2f54aaaa3786 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:37.539145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf01a49-7c0e-4266-92e7-2f54aaaa3786 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:37.673997 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6996f29-6a7f-47fc-ac80-7df9db2cbf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:37.675038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6996f29-6a7f-47fc-ac80-7df9db2cbf12 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:37.676106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6996f29-6a7f-47fc-ac80-7df9db2cbf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:37.676703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6996f29-6a7f-47fc-ac80-7df9db2cbf12 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:37.677847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6996f29-6a7f-47fc-ac80-7df9db2cbf12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:37.680663 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6996f29-6a7f-47fc-ac80-7df9db2cbf12 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:37.719114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1020/2043] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:51:37 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:37.721049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a2d77-9172-46a1-a4a3-6f9ec0133431 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:37.745488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a2d77-9172-46a1-a4a3-6f9ec0133431 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:37.760910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797108e2-c1a1-439e-87f5-7dd631737d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:37.761726 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797108e2-c1a1-439e-87f5-7dd631737d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:37.762013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797108e2-c1a1-439e-87f5-7dd631737d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:37.762287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797108e2-c1a1-439e-87f5-7dd631737d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:37.763083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797108e2-c1a1-439e-87f5-7dd631737d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:37.764711 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797108e2-c1a1-439e-87f5-7dd631737d84 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:37.792592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1024/2044] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:37.797015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6996f29-6a7f-47fc-ac80-7df9db2cbf12 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:37.819726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6996f29-6a7f-47fc-ac80-7df9db2cbf12 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:37.825697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf548e-f7bb-4412-a906-a46c75eb3feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:37.826865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf548e-f7bb-4412-a906-a46c75eb3feb admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:37.827505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf548e-f7bb-4412-a906-a46c75eb3feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:37.829739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf548e-f7bb-4412-a906-a46c75eb3feb admin admin] PATH_INFO: `/v3/projects/1bb8161e2cd74285a63f7a76164d21b8/users/c1ab47635281466eb7980832292209c8/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:37.865486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf548e-f7bb-4412-a906-a46c75eb3feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb8161e2cd74285a63f7a76164d21b8, user_id=c1ab47635281466eb7980832292209c8, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:37.871768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf548e-f7bb-4412-a906-a46c75eb3feb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:37.902764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1021/2045] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:37 2022] PUT /identity/v3/projects/1bb8161e2cd74285a63f7a76164d21b8/users/c1ab47635281466eb7980832292209c8/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:37.906712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797108e2-c1a1-439e-87f5-7dd631737d84 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:37.922312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797108e2-c1a1-439e-87f5-7dd631737d84 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:37.990940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:38.028117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7c04-0c4a-4f38-9e0b-6f2df7aa25d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:38.029012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7c04-0c4a-4f38-9e0b-6f2df7aa25d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:38.029446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7c04-0c4a-4f38-9e0b-6f2df7aa25d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:38.029873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7c04-0c4a-4f38-9e0b-6f2df7aa25d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:38.030773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7c04-0c4a-4f38-9e0b-6f2df7aa25d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:38.034158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7c04-0c4a-4f38-9e0b-6f2df7aa25d6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:38.046705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1025/2046] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:38.051593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf548e-f7bb-4412-a906-a46c75eb3feb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:38.064087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf548e-f7bb-4412-a906-a46c75eb3feb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:38.076178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec4faa-e202-452d-9f54-4d40690ed8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:38.076889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec4faa-e202-452d-9f54-4d40690ed8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:38.077178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec4faa-e202-452d-9f54-4d40690ed8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:38.077456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec4faa-e202-452d-9f54-4d40690ed8d3 admin admin] PATH_INFO: `/v3/projects/1bb8161e2cd74285a63f7a76164d21b8/users/c1ab47635281466eb7980832292209c8/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:38.081518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec4faa-e202-452d-9f54-4d40690ed8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb8161e2cd74285a63f7a76164d21b8, user_id=c1ab47635281466eb7980832292209c8, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:38.085245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec4faa-e202-452d-9f54-4d40690ed8d3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:38.089607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:38.102941 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1022/2047] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:38 2022] PUT /identity/v3/projects/1bb8161e2cd74285a63f7a76164d21b8/users/c1ab47635281466eb7980832292209c8/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:38.492992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a600-7e59-4543-aaa3-b37544c37b7b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:38.493745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a600-7e59-4543-aaa3-b37544c37b7b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:38.493745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a600-7e59-4543-aaa3-b37544c37b7b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:38.495897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1026/2048] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:51:38.528227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d490-5eaf-43f7-8b4e-c99983715aee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:38.528227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d490-5eaf-43f7-8b4e-c99983715aee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:38.528227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d490-5eaf-43f7-8b4e-c99983715aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:38.569264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ccc4d490-5eaf-43f7-8b4e-c99983715aee None None] MFA Rules not processed for user `beaec3b392e3468981992629101cf883`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:38.571298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ccc4d490-5eaf-43f7-8b4e-c99983715aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:38.597052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a600-7e59-4543-aaa3-b37544c37b7b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:38.599959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b8e4a600-7e59-4543-aaa3-b37544c37b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:38.670103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1023/2049] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:51:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:38.681554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d490-5eaf-43f7-8b4e-c99983715aee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:38.683670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ccc4d490-5eaf-43f7-8b4e-c99983715aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:38.704881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4d490-5eaf-43f7-8b4e-c99983715aee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:38.715198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0cb41-79b6-4da8-9b3c-f8e05bceab7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:38.716042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0cb41-79b6-4da8-9b3c-f8e05bceab7c service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:38.716394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0cb41-79b6-4da8-9b3c-f8e05bceab7c service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:38.717129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0cb41-79b6-4da8-9b3c-f8e05bceab7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:38.729437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0cb41-79b6-4da8-9b3c-f8e05bceab7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:38.731226 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0cb41-79b6-4da8-9b3c-f8e05bceab7c service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:38.742907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1024/2050] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:51:38.762949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a600-7e59-4543-aaa3-b37544c37b7b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:38.768716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:38.769958 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:38.770244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:38.770536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] PATH_INFO: `/v3/users/be2d0a6b52c8465a8ae2f46d1270ae38` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:38.771905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2d0a6b52c8465a8ae2f46d1270ae38)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:38.774161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:38.869858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2d0a6b52c8465a8ae2f46d1270ae38'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:38.892368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2d0a6b52c8465a8ae2f46d1270ae38'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:38.911271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2d0a6b52c8465a8ae2f46d1270ae38'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:38.912029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2d0a6b52c8465a8ae2f46d1270ae38'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:38.921464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-47ba2ebf-df1f-47d2-8a00-6b3ab92ad957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2d0a6b52c8465a8ae2f46d1270ae38'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:38.933810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1027/2051] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:51:38 2022] DELETE /identity/v3/users/be2d0a6b52c8465a8ae2f46d1270ae38 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:51:39.190043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0cb41-79b6-4da8-9b3c-f8e05bceab7c service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:39.206575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0cb41-79b6-4da8-9b3c-f8e05bceab7c service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:39.332920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:39.333599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:39.333881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:39.334160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] PATH_INFO: `/v3/projects/81e9270b6ae24d75b778de7e0ade50fc` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:39.336030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e9270b6ae24d75b778de7e0ade50fc)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:39.337988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:39.415501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e9270b6ae24d75b778de7e0ade50fc', 'request_id': 'req-74e07617-2f92-4235-b3f0-615be0b6aa5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:39.432218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e9270b6ae24d75b778de7e0ade50fc', 'request_id': 'req-74e07617-2f92-4235-b3f0-615be0b6aa5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:39.445734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e9270b6ae24d75b778de7e0ade50fc', 'request_id': 'req-74e07617-2f92-4235-b3f0-615be0b6aa5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:39.459828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] The token cache is being invalidate because project 81e9270b6ae24d75b778de7e0ade50fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:51:39.460128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:39.460787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-74e07617-2f92-4235-b3f0-615be0b6aa5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:39.466174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1025/2052] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:51:39 2022] DELETE /identity/v3/projects/81e9270b6ae24d75b778de7e0ade50fc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:39.469196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a2637-90f3-41d9-8530-a354e8d06f1c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:39.469196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a2637-90f3-41d9-8530-a354e8d06f1c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:39.469365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a2637-90f3-41d9-8530-a354e8d06f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:39.500430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0e0a2637-90f3-41d9-8530-a354e8d06f1c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:39.502077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e0a2637-90f3-41d9-8530-a354e8d06f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:39.576320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:39.593341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1028/2053] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:51:39.601484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76c632-9a5e-4e18-85c5-f2f8469ca75d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:39.602034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76c632-9a5e-4e18-85c5-f2f8469ca75d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:39.602034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76c632-9a5e-4e18-85c5-f2f8469ca75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:39.624057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2d76c632-9a5e-4e18-85c5-f2f8469ca75d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:39.625342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2d76c632-9a5e-4e18-85c5-f2f8469ca75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:39.633920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1026/2054] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:51:39.638345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a2637-90f3-41d9-8530-a354e8d06f1c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:39.648563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a2637-90f3-41d9-8530-a354e8d06f1c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:39.653473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122b8a3-1205-4bf8-b41d-af870a5486c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:39.654106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122b8a3-1205-4bf8-b41d-af870a5486c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:39.654389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122b8a3-1205-4bf8-b41d-af870a5486c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:39.654666 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122b8a3-1205-4bf8-b41d-af870a5486c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:39.655557 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122b8a3-1205-4bf8-b41d-af870a5486c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:51:39.655993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122b8a3-1205-4bf8-b41d-af870a5486c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:39.657659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122b8a3-1205-4bf8-b41d-af870a5486c0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:39.673925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1029/2055] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:51:39.679787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76c632-9a5e-4e18-85c5-f2f8469ca75d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:39.685730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:39.690533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76c632-9a5e-4e18-85c5-f2f8469ca75d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:39.697296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e8b1-31b2-4e4f-b2b8-fc4bf69146fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:39.698122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e8b1-31b2-4e4f-b2b8-fc4bf69146fc admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:39.698698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e8b1-31b2-4e4f-b2b8-fc4bf69146fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:39.700433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e8b1-31b2-4e4f-b2b8-fc4bf69146fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:39.702261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5e8b1-31b2-4e4f-b2b8-fc4bf69146fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:39.704533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5e8b1-31b2-4e4f-b2b8-fc4bf69146fc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:39.761643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122b8a3-1205-4bf8-b41d-af870a5486c0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:39.763377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1027/2056] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:51:39 2022] POST /identity/v3/projects => generated 403 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:39.777564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122b8a3-1205-4bf8-b41d-af870a5486c0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:39.900063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efc5c2-771f-481e-84b0-5803eeb099fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:39.901050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efc5c2-771f-481e-84b0-5803eeb099fe admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:39.902057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efc5c2-771f-481e-84b0-5803eeb099fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:39.904009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efc5c2-771f-481e-84b0-5803eeb099fe admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:39.905414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efc5c2-771f-481e-84b0-5803eeb099fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:39.910528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efc5c2-771f-481e-84b0-5803eeb099fe admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:39.940702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1030/2057] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:51:39 2022] POST /identity/v3/users => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:51:39.943862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e8b1-31b2-4e4f-b2b8-fc4bf69146fc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:39.966008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e8b1-31b2-4e4f-b2b8-fc4bf69146fc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:39.983588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a171b-d8b6-4b54-89ef-446e0fbce5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:39.984504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a171b-d8b6-4b54-89ef-446e0fbce5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:39.984972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a171b-d8b6-4b54-89ef-446e0fbce5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:39.985443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a171b-d8b6-4b54-89ef-446e0fbce5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:39.986342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a171b-d8b6-4b54-89ef-446e0fbce5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:39.991355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a171b-d8b6-4b54-89ef-446e0fbce5e9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:40.016350 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efc5c2-771f-481e-84b0-5803eeb099fe admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:40.016869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1028/2058] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:40.030173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efc5c2-771f-481e-84b0-5803eeb099fe admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:40.041147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bde97-e989-4ff8-80dc-a1f46e23050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:40.041783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bde97-e989-4ff8-80dc-a1f46e23050d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:40.042198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bde97-e989-4ff8-80dc-a1f46e23050d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:40.042474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bde97-e989-4ff8-80dc-a1f46e23050d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:40.043221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bde97-e989-4ff8-80dc-a1f46e23050d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:40.045081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bde97-e989-4ff8-80dc-a1f46e23050d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:40.059351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1031/2059] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:51:40.065707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a171b-d8b6-4b54-89ef-446e0fbce5e9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:40.082384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a171b-d8b6-4b54-89ef-446e0fbce5e9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:40.087842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac5ab-8120-4ce0-a712-319f57446cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:40.088362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac5ab-8120-4ce0-a712-319f57446cab admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:40.088792 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac5ab-8120-4ce0-a712-319f57446cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:40.089090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac5ab-8120-4ce0-a712-319f57446cab admin admin] PATH_INFO: `/v3/projects/a8a7b8afa05a48aeb2f47775a7b90498/users/c3d5bc895a314e359695d4d2199ae7ec/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:40.108452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac5ab-8120-4ce0-a712-319f57446cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a7b8afa05a48aeb2f47775a7b90498, user_id=c3d5bc895a314e359695d4d2199ae7ec, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:40.112424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac5ab-8120-4ce0-a712-319f57446cab admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:40.139579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1029/2060] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:40 2022] PUT /identity/v3/projects/a8a7b8afa05a48aeb2f47775a7b90498/users/c3d5bc895a314e359695d4d2199ae7ec/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:40.140856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4e49-5838-4094-86b0-f78b8d935435 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:40.141424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4e49-5838-4094-86b0-f78b8d935435 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:40.141424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4e49-5838-4094-86b0-f78b8d935435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:40.182163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-87de4e49-5838-4094-86b0-f78b8d935435 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:40.183993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-87de4e49-5838-4094-86b0-f78b8d935435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:40.273393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1032/2061] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:40.283422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac5ab-8120-4ce0-a712-319f57446cab admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:40.285832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b2cac5ab-8120-4ce0-a712-319f57446cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:40.389596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac5ab-8120-4ce0-a712-319f57446cab admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:40.394605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fd330-f997-4a1a-a9c0-479bc0492f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:40.395315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fd330-f997-4a1a-a9c0-479bc0492f49 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:40.395577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fd330-f997-4a1a-a9c0-479bc0492f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:40.396077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fd330-f997-4a1a-a9c0-479bc0492f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:40.408839 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fd330-f997-4a1a-a9c0-479bc0492f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:40.410996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fd330-f997-4a1a-a9c0-479bc0492f49 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:40.436233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1030/2062] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:40.942429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de4e49-5838-4094-86b0-f78b8d935435 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:40.945054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-87de4e49-5838-4094-86b0-f78b8d935435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:40.967205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de4e49-5838-4094-86b0-f78b8d935435 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:40.976675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:40.978790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:40.987063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:40.987063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] PATH_INFO: `/v3/users/c15dd07d86ec45f8ab90abedf599201c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:40.987063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15dd07d86ec45f8ab90abedf599201c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:40.993406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:41.124825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15dd07d86ec45f8ab90abedf599201c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:41.139545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15dd07d86ec45f8ab90abedf599201c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:41.143795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:41.170154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15dd07d86ec45f8ab90abedf599201c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:41.176205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15dd07d86ec45f8ab90abedf599201c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:41.189523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15dd07d86ec45f8ab90abedf599201c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:41.197504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1033/2063] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:51:40 2022] DELETE /identity/v3/users/c15dd07d86ec45f8ab90abedf599201c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:41.204158 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359affd6-5138-4cfa-9d95-d7c3d8838f06 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:41.205156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359affd6-5138-4cfa-9d95-d7c3d8838f06 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:41.205611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359affd6-5138-4cfa-9d95-d7c3d8838f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:41.268616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-359affd6-5138-4cfa-9d95-d7c3d8838f06 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:41.270918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-359affd6-5138-4cfa-9d95-d7c3d8838f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:41.461264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1031/2064] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:41.471852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:41.473609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:41.623499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aacaa-3ab8-4ffd-99c2-c4283f14d826 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:41.632417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45399220-25cb-4124-a258-9be05ec4408c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:41.633115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399220-25cb-4124-a258-9be05ec4408c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:41.633396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399220-25cb-4124-a258-9be05ec4408c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:41.633670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399220-25cb-4124-a258-9be05ec4408c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:41.670181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45399220-25cb-4124-a258-9be05ec4408c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:41.671705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45399220-25cb-4124-a258-9be05ec4408c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:41.710783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1034/2065] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:41.999849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359affd6-5138-4cfa-9d95-d7c3d8838f06 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:42.001797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-359affd6-5138-4cfa-9d95-d7c3d8838f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:42.025879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359affd6-5138-4cfa-9d95-d7c3d8838f06 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:42.030148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:42.030816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:42.031421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:42.031421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] PATH_INFO: `/v3/projects/885070b1ca554f888588bc0661b6e60e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:42.032964 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] RBAC: Authorizing `identity:delete_project(project_id=885070b1ca554f888588bc0661b6e60e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:42.034586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:42.102845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:42.111374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885070b1ca554f888588bc0661b6e60e', 'request_id': 'req-d94a4753-c12c-47a3-8598-840166cb121e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:42.129497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885070b1ca554f888588bc0661b6e60e', 'request_id': 'req-d94a4753-c12c-47a3-8598-840166cb121e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:42.139568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885070b1ca554f888588bc0661b6e60e', 'request_id': 'req-d94a4753-c12c-47a3-8598-840166cb121e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:42.156518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] The token cache is being invalidate because project 885070b1ca554f888588bc0661b6e60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:51:42.156818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:42.157524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:42.159344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1032/2066] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:51:41 2022] DELETE /identity/v3/projects/885070b1ca554f888588bc0661b6e60e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:42.600961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6e78-e0ca-40ce-8460-254a6de7e2f3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:42.601547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6e78-e0ca-40ce-8460-254a6de7e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:42.601547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6e78-e0ca-40ce-8460-254a6de7e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:42.662520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e31f6e78-e0ca-40ce-8460-254a6de7e2f3 None None] MFA Rules not processed for user `c3d5bc895a314e359695d4d2199ae7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:42.664065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e31f6e78-e0ca-40ce-8460-254a6de7e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:42.804993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1035/2067] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:42.809571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:42.814043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:42.909531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a4753-c12c-47a3-8598-840166cb121e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:42.916710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3453d6-3a50-4810-942d-324e9b759689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:42.917732 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3453d6-3a50-4810-942d-324e9b759689 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:42.918153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3453d6-3a50-4810-942d-324e9b759689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:42.918561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3453d6-3a50-4810-942d-324e9b759689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:42.919378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3453d6-3a50-4810-942d-324e9b759689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:42.921467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3453d6-3a50-4810-942d-324e9b759689 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:42.978764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1033/2068] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:51:42 2022] POST /identity/v3/projects => generated 401 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:42.979017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6e78-e0ca-40ce-8460-254a6de7e2f3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:42.997823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6e78-e0ca-40ce-8460-254a6de7e2f3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:43.115282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08cc45-d8d2-4430-86cd-5956d641c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:43.116324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08cc45-d8d2-4430-86cd-5956d641c687 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:43.116324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08cc45-d8d2-4430-86cd-5956d641c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:43.116546 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08cc45-d8d2-4430-86cd-5956d641c687 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:43.117232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08cc45-d8d2-4430-86cd-5956d641c687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:43.119247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08cc45-d8d2-4430-86cd-5956d641c687 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:43.132143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:43.149475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1036/2069] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:51:42 2022] POST /identity/v3/users => generated 307 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:43.153021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3453d6-3a50-4810-942d-324e9b759689 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:43.166683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3453d6-3a50-4810-942d-324e9b759689 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:43.175506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4118bc-a0cc-4ae6-a0fd-c6f7d9909ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:43.176688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4118bc-a0cc-4ae6-a0fd-c6f7d9909ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:43.177193 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4118bc-a0cc-4ae6-a0fd-c6f7d9909ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:43.177654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4118bc-a0cc-4ae6-a0fd-c6f7d9909ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:43.183798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4118bc-a0cc-4ae6-a0fd-c6f7d9909ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:43.186182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4118bc-a0cc-4ae6-a0fd-c6f7d9909ef1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:43.203146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1034/2070] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:43.209656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08cc45-d8d2-4430-86cd-5956d641c687 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:43.226426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08cc45-d8d2-4430-86cd-5956d641c687 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:43.235527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bf0f6-bb49-41a9-973c-999bdaaa4b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:43.236778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bf0f6-bb49-41a9-973c-999bdaaa4b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:43.237279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bf0f6-bb49-41a9-973c-999bdaaa4b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:43.237801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bf0f6-bb49-41a9-973c-999bdaaa4b0a admin admin] PATH_INFO: `/v3/projects/579f279ab7884254a0adfa6e858b7d1c/users/96cb4e560aa54c86b7bf0edcfaab70ff/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:43.275081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bf0f6-bb49-41a9-973c-999bdaaa4b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=579f279ab7884254a0adfa6e858b7d1c, user_id=96cb4e560aa54c86b7bf0edcfaab70ff, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:43.295219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bf0f6-bb49-41a9-973c-999bdaaa4b0a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:43.327653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1037/2071] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:43 2022] PUT /identity/v3/projects/579f279ab7884254a0adfa6e858b7d1c/users/96cb4e560aa54c86b7bf0edcfaab70ff/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:43.332161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4118bc-a0cc-4ae6-a0fd-c6f7d9909ef1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:43.378185 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4118bc-a0cc-4ae6-a0fd-c6f7d9909ef1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:43.545631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e68e1-b014-4476-b25e-0ca9856b55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:43.547118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e68e1-b014-4476-b25e-0ca9856b55e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:43.547780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e68e1-b014-4476-b25e-0ca9856b55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:43.548276 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e68e1-b014-4476-b25e-0ca9856b55e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:43.549222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e68e1-b014-4476-b25e-0ca9856b55e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:43.552220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e68e1-b014-4476-b25e-0ca9856b55e2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:43.582929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1035/2072] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:43.585222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bf0f6-bb49-41a9-973c-999bdaaa4b0a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:43.598218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bf0f6-bb49-41a9-973c-999bdaaa4b0a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:43.611283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbc7af-5241-433c-b204-a48e57ade2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:43.612083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc7af-5241-433c-b204-a48e57ade2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:43.612249 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc7af-5241-433c-b204-a48e57ade2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:43.613284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc7af-5241-433c-b204-a48e57ade2c3 admin admin] PATH_INFO: `/v3/projects/579f279ab7884254a0adfa6e858b7d1c/users/96cb4e560aa54c86b7bf0edcfaab70ff/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:43.615342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbc7af-5241-433c-b204-a48e57ade2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579f279ab7884254a0adfa6e858b7d1c, user_id=96cb4e560aa54c86b7bf0edcfaab70ff, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:43.617853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbc7af-5241-433c-b204-a48e57ade2c3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:43.636938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1038/2073] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:43 2022] PUT /identity/v3/projects/579f279ab7884254a0adfa6e858b7d1c/users/96cb4e560aa54c86b7bf0edcfaab70ff/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:44.524790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6085a-583f-468e-a522-09dd92c6d3df None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:44.525275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6085a-583f-468e-a522-09dd92c6d3df None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:44.525379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6085a-583f-468e-a522-09dd92c6d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:44.555947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-07d6085a-583f-468e-a522-09dd92c6d3df None None] MFA Rules not processed for user `c1ab47635281466eb7980832292209c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:44.557476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-07d6085a-583f-468e-a522-09dd92c6d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:44.617002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:44.696242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1036/2074] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:44.713343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbc7af-5241-433c-b204-a48e57ade2c3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:44.715367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f6bbc7af-5241-433c-b204-a48e57ade2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:44.829276 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663d478-09d4-4d6f-9f83-5cb32c120c8d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:44.830018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663d478-09d4-4d6f-9f83-5cb32c120c8d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:44.830579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663d478-09d4-4d6f-9f83-5cb32c120c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:44.839713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbc7af-5241-433c-b204-a48e57ade2c3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:44.844024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cdb1e-aebc-4300-80e5-f13cbacefd4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7a3c5f6b9645fb8cd2a65cee4f37c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:44.844656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdb1e-aebc-4300-80e5-f13cbacefd4b service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:44.844936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdb1e-aebc-4300-80e5-f13cbacefd4b service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:44.845207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdb1e-aebc-4300-80e5-f13cbacefd4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:44.848117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e17cdb1e-aebc-4300-80e5-f13cbacefd4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:44.897115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c663d478-09d4-4d6f-9f83-5cb32c120c8d None None] MFA Rules not processed for user `96cb4e560aa54c86b7bf0edcfaab70ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:44.899108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c663d478-09d4-4d6f-9f83-5cb32c120c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:44.980176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cdb1e-aebc-4300-80e5-f13cbacefd4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:44.981636 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cdb1e-aebc-4300-80e5-f13cbacefd4b service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:44.998823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1039/2075] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:45.108722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1037/2076] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:51:45.194286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ccc85-e477-4664-8d10-26646ad8ab38 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:45.194568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ccc85-e477-4664-8d10-26646ad8ab38 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:45.194841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ccc85-e477-4664-8d10-26646ad8ab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:45.216048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7f1ccc85-e477-4664-8d10-26646ad8ab38 None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:45.217260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7f1ccc85-e477-4664-8d10-26646ad8ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:45.323079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1040/2077] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:51:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:45.337127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663d478-09d4-4d6f-9f83-5cb32c120c8d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:45.341345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c663d478-09d4-4d6f-9f83-5cb32c120c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:45.481101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663d478-09d4-4d6f-9f83-5cb32c120c8d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:45.493092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b819b4c-3746-4fc3-a644-d01d858cb6c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:45.493900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819b4c-3746-4fc3-a644-d01d858cb6c7 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:45.494230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819b4c-3746-4fc3-a644-d01d858cb6c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:45.494527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819b4c-3746-4fc3-a644-d01d858cb6c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:45.507569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b819b4c-3746-4fc3-a644-d01d858cb6c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:45.514552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b819b4c-3746-4fc3-a644-d01d858cb6c7 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:45.546446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1038/2078] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:51:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:51:46.918954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee31c60-01cd-46b5-bf4c-0eceda5c6de9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:46.919590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee31c60-01cd-46b5-bf4c-0eceda5c6de9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:46.919590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee31c60-01cd-46b5-bf4c-0eceda5c6de9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:46.920948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1041/2079] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:51:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:51:46.971446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c81b15-ca6d-49cc-b445-37d02d56a829 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:46.972607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c81b15-ca6d-49cc-b445-37d02d56a829 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:46.972607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c81b15-ca6d-49cc-b445-37d02d56a829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:47.004554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-68c81b15-ca6d-49cc-b445-37d02d56a829 None None] MFA Rules not processed for user `beaec3b392e3468981992629101cf883`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:47.006427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-68c81b15-ca6d-49cc-b445-37d02d56a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:47.094203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:47.148595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1039/2080] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:47.298538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee31c60-01cd-46b5-bf4c-0eceda5c6de9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:47.305295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c81b15-ca6d-49cc-b445-37d02d56a829 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:47.307855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-68c81b15-ca6d-49cc-b445-37d02d56a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:47.330393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c81b15-ca6d-49cc-b445-37d02d56a829 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:47.338462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:47.343442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059575b-2612-4ee9-8345-e8b55482acf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:47.344229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059575b-2612-4ee9-8345-e8b55482acf5 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:47.344584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059575b-2612-4ee9-8345-e8b55482acf5 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:47.344932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059575b-2612-4ee9-8345-e8b55482acf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:47.362203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059575b-2612-4ee9-8345-e8b55482acf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:47.364644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059575b-2612-4ee9-8345-e8b55482acf5 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:47.403147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1040/2081] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:47.457314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee31c60-01cd-46b5-bf4c-0eceda5c6de9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:47.463499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:47.469236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:47.469806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:47.470261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] PATH_INFO: `/v3/users/c3d5bc895a314e359695d4d2199ae7ec` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:47.471749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d5bc895a314e359695d4d2199ae7ec)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:47.474574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:47.551611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d5bc895a314e359695d4d2199ae7ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:47.566937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d5bc895a314e359695d4d2199ae7ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:47.586816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d5bc895a314e359695d4d2199ae7ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:47.588132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d5bc895a314e359695d4d2199ae7ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:47.596710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d5bc895a314e359695d4d2199ae7ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:47.610165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1042/2082] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:51:47 2022] DELETE /identity/v3/users/c3d5bc895a314e359695d4d2199ae7ec => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:47.897944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059575b-2612-4ee9-8345-e8b55482acf5 service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:47.927421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059575b-2612-4ee9-8345-e8b55482acf5 service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:48.002748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:48.004359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:48.004860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:48.005292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] PATH_INFO: `/v3/projects/a8a7b8afa05a48aeb2f47775a7b90498` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:48.006700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a7b8afa05a48aeb2f47775a7b90498)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:48.008824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:48.068540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a7b8afa05a48aeb2f47775a7b90498', 'request_id': 'req-bc3375ce-0629-44f1-8d0a-49daf10d4277'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.076609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a7b8afa05a48aeb2f47775a7b90498', 'request_id': 'req-bc3375ce-0629-44f1-8d0a-49daf10d4277'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.083397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a7b8afa05a48aeb2f47775a7b90498', 'request_id': 'req-bc3375ce-0629-44f1-8d0a-49daf10d4277'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.095462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] The token cache is being invalidate because project a8a7b8afa05a48aeb2f47775a7b90498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:51:48.095863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.096694 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.100155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1041/2083] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:51:47 2022] DELETE /identity/v3/projects/a8a7b8afa05a48aeb2f47775a7b90498 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:48.104135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:48.105648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:48.121356 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e44b5e-7614-4c8e-8d10-ae6a70736911 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:48.210322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:48.211004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:48.211285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:48.211558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] PATH_INFO: `/v3/users/96cb4e560aa54c86b7bf0edcfaab70ff` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:48.212782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96cb4e560aa54c86b7bf0edcfaab70ff)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:48.214742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:48.278132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:48.288845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96cb4e560aa54c86b7bf0edcfaab70ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.299160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96cb4e560aa54c86b7bf0edcfaab70ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.338116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96cb4e560aa54c86b7bf0edcfaab70ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.342389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96cb4e560aa54c86b7bf0edcfaab70ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.355069 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-170a9e87-b45a-450e-8437-353ad7356e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96cb4e560aa54c86b7bf0edcfaab70ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.367540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1043/2084] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:51:48 2022] DELETE /identity/v3/users/96cb4e560aa54c86b7bf0edcfaab70ff => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:48.618354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:48.620421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:48.657346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3375ce-0629-44f1-8d0a-49daf10d4277 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:48.777439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:48.788315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:48.789379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:48.789906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:48.791029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] PATH_INFO: `/v3/projects/579f279ab7884254a0adfa6e858b7d1c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:48.792894 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579f279ab7884254a0adfa6e858b7d1c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:48.795374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:48.866975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579f279ab7884254a0adfa6e858b7d1c', 'request_id': 'req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.878612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579f279ab7884254a0adfa6e858b7d1c', 'request_id': 'req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.888041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579f279ab7884254a0adfa6e858b7d1c', 'request_id': 'req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.915622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] The token cache is being invalidate because project 579f279ab7884254a0adfa6e858b7d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:51:48.915838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.916560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3dfe822c-c1bf-44a0-9e2e-272c6fa93a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:51:48.921801 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1042/2085] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:51:48 2022] DELETE /identity/v3/projects/579f279ab7884254a0adfa6e858b7d1c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:48.924702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8dfb-a3df-41dd-82ac-b921385dbbd9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:48.925035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8dfb-a3df-41dd-82ac-b921385dbbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:48.925367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8dfb-a3df-41dd-82ac-b921385dbbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:48.959687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-170c8dfb-a3df-41dd-82ac-b921385dbbd9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:48.961314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-170c8dfb-a3df-41dd-82ac-b921385dbbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:49.097614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1044/2086] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:49.099661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66229e31-2291-4109-9b31-0cbc493c8adc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:49.100192 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66229e31-2291-4109-9b31-0cbc493c8adc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:49.100192 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66229e31-2291-4109-9b31-0cbc493c8adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:49.130346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-66229e31-2291-4109-9b31-0cbc493c8adc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:49.131897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-66229e31-2291-4109-9b31-0cbc493c8adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:49.149072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1043/2087] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:49.183031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8dfb-a3df-41dd-82ac-b921385dbbd9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:49.192186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8dfb-a3df-41dd-82ac-b921385dbbd9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:49.198499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b822e-f631-44b0-9bd2-3b62ae551006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:49.199401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b822e-f631-44b0-9bd2-3b62ae551006 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:49.199965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b822e-f631-44b0-9bd2-3b62ae551006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:49.200245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b822e-f631-44b0-9bd2-3b62ae551006 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:49.200960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b822e-f631-44b0-9bd2-3b62ae551006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:51:49.201262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b822e-f631-44b0-9bd2-3b62ae551006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:49.203061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b822e-f631-44b0-9bd2-3b62ae551006 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:49.217595 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1045/2088] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:51:49.222467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66229e31-2291-4109-9b31-0cbc493c8adc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:49.232970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66229e31-2291-4109-9b31-0cbc493c8adc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:49.238856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2f10c-afbf-4493-9ebe-97c6ed637e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:49.239608 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2f10c-afbf-4493-9ebe-97c6ed637e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:49.239988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2f10c-afbf-4493-9ebe-97c6ed637e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:49.240359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2f10c-afbf-4493-9ebe-97c6ed637e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:49.243352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2f10c-afbf-4493-9ebe-97c6ed637e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:49.245197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2f10c-afbf-4493-9ebe-97c6ed637e02 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:49.282651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1044/2089] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:51:49 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:49.290144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b822e-f631-44b0-9bd2-3b62ae551006 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:49.302967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b822e-f631-44b0-9bd2-3b62ae551006 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:49.405388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe89919-8ca6-4db5-91b5-c6665c66d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:49.406025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89919-8ca6-4db5-91b5-c6665c66d616 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:49.406309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89919-8ca6-4db5-91b5-c6665c66d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:49.406589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89919-8ca6-4db5-91b5-c6665c66d616 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:49.407323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe89919-8ca6-4db5-91b5-c6665c66d616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:49.409258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe89919-8ca6-4db5-91b5-c6665c66d616 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:49.450937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1046/2090] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:51:49 2022] POST /identity/v3/users => generated 282 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:49.454336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2f10c-afbf-4493-9ebe-97c6ed637e02 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:49.471254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2f10c-afbf-4493-9ebe-97c6ed637e02 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:49.478947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17d453-6cad-4e97-8111-fff4e6e095f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:49.479701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17d453-6cad-4e97-8111-fff4e6e095f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:49.479989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17d453-6cad-4e97-8111-fff4e6e095f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:49.480343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17d453-6cad-4e97-8111-fff4e6e095f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:49.481109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17d453-6cad-4e97-8111-fff4e6e095f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:49.482838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17d453-6cad-4e97-8111-fff4e6e095f9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:49.495626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1045/2091] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:49.500050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe89919-8ca6-4db5-91b5-c6665c66d616 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:49.512662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe89919-8ca6-4db5-91b5-c6665c66d616 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:49.520648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98be96-c7a7-4d35-a08e-bcf1542f9fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:49.521730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98be96-c7a7-4d35-a08e-bcf1542f9fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:49.522257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98be96-c7a7-4d35-a08e-bcf1542f9fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:49.522790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98be96-c7a7-4d35-a08e-bcf1542f9fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:49.523828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98be96-c7a7-4d35-a08e-bcf1542f9fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:49.525968 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98be96-c7a7-4d35-a08e-bcf1542f9fd3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:49.543569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1047/2092] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:49.548424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17d453-6cad-4e97-8111-fff4e6e095f9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:49.561804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17d453-6cad-4e97-8111-fff4e6e095f9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:49.568535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af22436-d010-4495-a4f5-ee5961ebf142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:49.571199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af22436-d010-4495-a4f5-ee5961ebf142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:49.572615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af22436-d010-4495-a4f5-ee5961ebf142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:49.573146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af22436-d010-4495-a4f5-ee5961ebf142 admin admin] PATH_INFO: `/v3/projects/4dddeddd620e47809a6470a0feafb92f/users/1282859e0433483088405d2c9201efe0/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:49.608831 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af22436-d010-4495-a4f5-ee5961ebf142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dddeddd620e47809a6470a0feafb92f, user_id=1282859e0433483088405d2c9201efe0, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:49.612067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af22436-d010-4495-a4f5-ee5961ebf142 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:49.634409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1046/2093] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:49 2022] PUT /identity/v3/projects/4dddeddd620e47809a6470a0feafb92f/users/1282859e0433483088405d2c9201efe0/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:49.648590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33803-33f8-4354-91b5-e763dd4818a2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:49.649178 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33803-33f8-4354-91b5-e763dd4818a2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:49.649664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33803-33f8-4354-91b5-e763dd4818a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:49.683933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e8f33803-33f8-4354-91b5-e763dd4818a2 None None] MFA Rules not processed for user `1282859e0433483088405d2c9201efe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:49.685217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e8f33803-33f8-4354-91b5-e763dd4818a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:49.700270 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:49.802971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1048/2094] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:51:49.804591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af22436-d010-4495-a4f5-ee5961ebf142 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:49.904433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af22436-d010-4495-a4f5-ee5961ebf142 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:49.911452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42a184-a659-4b14-b378-4bf623ee8aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:49.912221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a184-a659-4b14-b378-4bf623ee8aae admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:49.912596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a184-a659-4b14-b378-4bf623ee8aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:49.912967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a184-a659-4b14-b378-4bf623ee8aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:49.913742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42a184-a659-4b14-b378-4bf623ee8aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:49.915782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42a184-a659-4b14-b378-4bf623ee8aae admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:49.967186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1047/2095] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:51:49 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:51:49.970826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33803-33f8-4354-91b5-e763dd4818a2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:49.985333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33803-33f8-4354-91b5-e763dd4818a2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:50.068548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abfb29-be29-49ce-bfd9-63a4289af363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:50.068990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abfb29-be29-49ce-bfd9-63a4289af363 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:50.069281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abfb29-be29-49ce-bfd9-63a4289af363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:50.069977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abfb29-be29-49ce-bfd9-63a4289af363 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:50.070826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abfb29-be29-49ce-bfd9-63a4289af363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:50.073003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abfb29-be29-49ce-bfd9-63a4289af363 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:50.103680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1049/2096] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:51:49 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:51:50.108047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42a184-a659-4b14-b378-4bf623ee8aae admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:50.123325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42a184-a659-4b14-b378-4bf623ee8aae admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:50.131033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68091b66-ab76-43c5-a6bb-5caf043cae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:50.132000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68091b66-ab76-43c5-a6bb-5caf043cae4f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:50.132285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68091b66-ab76-43c5-a6bb-5caf043cae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:50.132563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68091b66-ab76-43c5-a6bb-5caf043cae4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:50.133409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68091b66-ab76-43c5-a6bb-5caf043cae4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:50.135054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68091b66-ab76-43c5-a6bb-5caf043cae4f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:50.137169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:50.152985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1048/2097] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:50.154367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abfb29-be29-49ce-bfd9-63a4289af363 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:50.168933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abfb29-be29-49ce-bfd9-63a4289af363 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:50.175947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd98e6-5602-42be-bc03-5151c226d77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:50.176949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd98e6-5602-42be-bc03-5151c226d77c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:50.177604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd98e6-5602-42be-bc03-5151c226d77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:50.179589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd98e6-5602-42be-bc03-5151c226d77c admin admin] PATH_INFO: `/v3/projects/d3bb2ba0b7eb46e38b06d29376109bcf/users/ee99d57e3e1a47c2aedbe6a2b5de903c/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:50.203115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd98e6-5602-42be-bc03-5151c226d77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bb2ba0b7eb46e38b06d29376109bcf, user_id=ee99d57e3e1a47c2aedbe6a2b5de903c, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:50.212278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd98e6-5602-42be-bc03-5151c226d77c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:50.233501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1050/2098] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:50 2022] PUT /identity/v3/projects/d3bb2ba0b7eb46e38b06d29376109bcf/users/ee99d57e3e1a47c2aedbe6a2b5de903c/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:51:50.234244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68091b66-ab76-43c5-a6bb-5caf043cae4f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:50.245438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68091b66-ab76-43c5-a6bb-5caf043cae4f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:50.325498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dcb01-e946-49a0-b8b7-08404489de6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:50.326401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dcb01-e946-49a0-b8b7-08404489de6c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:50.328043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dcb01-e946-49a0-b8b7-08404489de6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:50.328506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dcb01-e946-49a0-b8b7-08404489de6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:50.329405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dcb01-e946-49a0-b8b7-08404489de6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:50.333238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dcb01-e946-49a0-b8b7-08404489de6c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:50.348398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1049/2099] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:51:50.353148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd98e6-5602-42be-bc03-5151c226d77c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:50.365934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd98e6-5602-42be-bc03-5151c226d77c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:50.374561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd176-cdf3-4c85-b870-3ed2eccc70fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:50.375534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd176-cdf3-4c85-b870-3ed2eccc70fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:50.375918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd176-cdf3-4c85-b870-3ed2eccc70fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:50.376297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd176-cdf3-4c85-b870-3ed2eccc70fb admin admin] PATH_INFO: `/v3/projects/d3bb2ba0b7eb46e38b06d29376109bcf/users/ee99d57e3e1a47c2aedbe6a2b5de903c/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:50.381222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd176-cdf3-4c85-b870-3ed2eccc70fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bb2ba0b7eb46e38b06d29376109bcf, user_id=ee99d57e3e1a47c2aedbe6a2b5de903c, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:50.387199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd176-cdf3-4c85-b870-3ed2eccc70fb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:50.399640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1051/2100] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:51:50 2022] PUT /identity/v3/projects/d3bb2ba0b7eb46e38b06d29376109bcf/users/ee99d57e3e1a47c2aedbe6a2b5de903c/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:51:50.410563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e1b4-2752-4016-92fc-13dbe68f0ad6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:50.410866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e1b4-2752-4016-92fc-13dbe68f0ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:50.411151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e1b4-2752-4016-92fc-13dbe68f0ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:50.450428 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9425e1b4-2752-4016-92fc-13dbe68f0ad6 None None] MFA Rules not processed for user `ee99d57e3e1a47c2aedbe6a2b5de903c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:50.451702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9425e1b4-2752-4016-92fc-13dbe68f0ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:50.582406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1050/2101] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:51:50.595300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd176-cdf3-4c85-b870-3ed2eccc70fb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:50.598720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-90bcd176-cdf3-4c85-b870-3ed2eccc70fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:50.742989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd176-cdf3-4c85-b870-3ed2eccc70fb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:50.752828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb332703-cdef-4a96-b386-ba25f6dca731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:50.754517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332703-cdef-4a96-b386-ba25f6dca731 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:50.755011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332703-cdef-4a96-b386-ba25f6dca731 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:50.755444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb332703-cdef-4a96-b386-ba25f6dca731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:50.780457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb332703-cdef-4a96-b386-ba25f6dca731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:50.783330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb332703-cdef-4a96-b386-ba25f6dca731 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:50.805628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1052/2102] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:50.945458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e1b4-2752-4016-92fc-13dbe68f0ad6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:51:50.957165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e1b4-2752-4016-92fc-13dbe68f0ad6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:51:50.961610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecf39d-6a1f-47d7-a580-f0dfac6b8831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:51:50.962245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecf39d-6a1f-47d7-a580-f0dfac6b8831 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:50.962526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecf39d-6a1f-47d7-a580-f0dfac6b8831 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:50.962803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecf39d-6a1f-47d7-a580-f0dfac6b8831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:51.067174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecf39d-6a1f-47d7-a580-f0dfac6b8831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:51:51.069354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecf39d-6a1f-47d7-a580-f0dfac6b8831 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:51:51.117196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1051/2103] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:51:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:51:56.544367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d713-0259-4881-a7a0-165e7764ae5b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:51:56.544949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d713-0259-4881-a7a0-165e7764ae5b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:51:56.544949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d713-0259-4881-a7a0-165e7764ae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:51:56.558362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:56.564647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c6e8d713-0259-4881-a7a0-165e7764ae5b None None] MFA Rules not processed for user `08692d3eaab8431f8af3da2c1e098ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:51:56.567155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c6e8d713-0259-4881-a7a0-165e7764ae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:51:56.622659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1053/2104] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:51:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:00.055990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e1e63-4a55-4a00-9369-d705125c3ff6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:00.056538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e1e63-4a55-4a00-9369-d705125c3ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:00.056634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e1e63-4a55-4a00-9369-d705125c3ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:00.076938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e45e1e63-4a55-4a00-9369-d705125c3ff6 None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:00.078208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e45e1e63-4a55-4a00-9369-d705125c3ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:00.090243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:00.141331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1052/2105] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:52:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:00.156115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d713-0259-4881-a7a0-165e7764ae5b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:00.157749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c6e8d713-0259-4881-a7a0-165e7764ae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:00.237419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d713-0259-4881-a7a0-165e7764ae5b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:00.243459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b7e7b-f96c-4bdf-abb4-70e849b1de7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:00.244101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b7e7b-f96c-4bdf-abb4-70e849b1de7c service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:00.244382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b7e7b-f96c-4bdf-abb4-70e849b1de7c service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:00.244657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b7e7b-f96c-4bdf-abb4-70e849b1de7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:00.253680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b7e7b-f96c-4bdf-abb4-70e849b1de7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:00.255362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b7e7b-f96c-4bdf-abb4-70e849b1de7c service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:00.264922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1054/2106] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:52:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 07:52:01.913373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e1e63-4a55-4a00-9369-d705125c3ff6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:01.914828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e45e1e63-4a55-4a00-9369-d705125c3ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:01.984332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e1e63-4a55-4a00-9369-d705125c3ff6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:01.989809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:01.991109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:01.991389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:01.991659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] PATH_INFO: `/v3/users/44e2fdcb72da4928b0e7d2fb02f8634a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:01.992880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e2fdcb72da4928b0e7d2fb02f8634a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:01.994919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:02.064791 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e2fdcb72da4928b0e7d2fb02f8634a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.081829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e2fdcb72da4928b0e7d2fb02f8634a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.082701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e2fdcb72da4928b0e7d2fb02f8634a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.096087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e2fdcb72da4928b0e7d2fb02f8634a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.097059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e2fdcb72da4928b0e7d2fb02f8634a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.112183 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1053/2107] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:52:01 2022] DELETE /identity/v3/users/44e2fdcb72da4928b0e7d2fb02f8634a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:02.116744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401201-c41a-4cc1-8d59-56399cc235c5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:02.117234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401201-c41a-4cc1-8d59-56399cc235c5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:02.117327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401201-c41a-4cc1-8d59-56399cc235c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:02.137254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fa401201-c41a-4cc1-8d59-56399cc235c5 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:02.138770 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fa401201-c41a-4cc1-8d59-56399cc235c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:02.245272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1055/2108] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:02.255016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:02.255016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:02.319408 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:02.340980 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021dc0c-58be-4eb5-a2aa-29312930a83b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:02.346015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a08ba3-3b16-47d7-9461-a060c6a05aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:02.347072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a08ba3-3b16-47d7-9461-a060c6a05aac service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:02.347500 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a08ba3-3b16-47d7-9461-a060c6a05aac service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:02.347918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a08ba3-3b16-47d7-9461-a060c6a05aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:02.362719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a08ba3-3b16-47d7-9461-a060c6a05aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:02.367155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a08ba3-3b16-47d7-9461-a060c6a05aac service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:02.379975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1054/2109] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:02.747797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401201-c41a-4cc1-8d59-56399cc235c5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:02.749294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fa401201-c41a-4cc1-8d59-56399cc235c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:02.763965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401201-c41a-4cc1-8d59-56399cc235c5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:02.770679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:02.770679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:02.770679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:02.770679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] PATH_INFO: `/v3/projects/6e19f3057a3b49f98f53e9ce02f32b4c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:02.771225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e19f3057a3b49f98f53e9ce02f32b4c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:02.773691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:02.824275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:02.842927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e19f3057a3b49f98f53e9ce02f32b4c', 'request_id': 'req-9e3abb62-be90-4016-8baf-d93a061c2f7e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.853381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e19f3057a3b49f98f53e9ce02f32b4c', 'request_id': 'req-9e3abb62-be90-4016-8baf-d93a061c2f7e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.860365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e19f3057a3b49f98f53e9ce02f32b4c', 'request_id': 'req-9e3abb62-be90-4016-8baf-d93a061c2f7e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.873828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] The token cache is being invalidate because project 6e19f3057a3b49f98f53e9ce02f32b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:52:02.874296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.875128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e3abb62-be90-4016-8baf-d93a061c2f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:02.876716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1056/2110] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:52:02 2022] DELETE /identity/v3/projects/6e19f3057a3b49f98f53e9ce02f32b4c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:02.881682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43a843-061a-40d8-a876-b91a831f5fcd None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:02.882016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43a843-061a-40d8-a876-b91a831f5fcd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:02.882297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43a843-061a-40d8-a876-b91a831f5fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:02.910233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4f43a843-061a-40d8-a876-b91a831f5fcd None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:02.911887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4f43a843-061a-40d8-a876-b91a831f5fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:03.012639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1055/2111] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:03.020996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef01df-2581-4c9e-9144-de613a8b0f9f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.021389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef01df-2581-4c9e-9144-de613a8b0f9f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.022138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef01df-2581-4c9e-9144-de613a8b0f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.043655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b1ef01df-2581-4c9e-9144-de613a8b0f9f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:03.044873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b1ef01df-2581-4c9e-9144-de613a8b0f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:03.052929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1057/2112] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:03.057329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43a843-061a-40d8-a876-b91a831f5fcd None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:03.067543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43a843-061a-40d8-a876-b91a831f5fcd None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:03.072353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca389b-0b21-4905-b152-4b7146f25ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:03.073120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca389b-0b21-4905-b152-4b7146f25ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.073398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca389b-0b21-4905-b152-4b7146f25ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.073723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca389b-0b21-4905-b152-4b7146f25ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.074384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca389b-0b21-4905-b152-4b7146f25ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:52:03.074714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca389b-0b21-4905-b152-4b7146f25ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:03.076436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca389b-0b21-4905-b152-4b7146f25ddb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:03.089724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1056/2113] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:52:03.094494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef01df-2581-4c9e-9144-de613a8b0f9f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:03.105041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef01df-2581-4c9e-9144-de613a8b0f9f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:03.110252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37f76-f94d-4ed5-9b3f-2a3dfbdac406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:03.111313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37f76-f94d-4ed5-9b3f-2a3dfbdac406 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.111711 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37f76-f94d-4ed5-9b3f-2a3dfbdac406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.112024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37f76-f94d-4ed5-9b3f-2a3dfbdac406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.112787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37f76-f94d-4ed5-9b3f-2a3dfbdac406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:03.115329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37f76-f94d-4ed5-9b3f-2a3dfbdac406 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:03.145228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1058/2114] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:52:03 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:03.150194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca389b-0b21-4905-b152-4b7146f25ddb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:03.160996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca389b-0b21-4905-b152-4b7146f25ddb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:03.240640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6fbd8-017e-4993-9fe7-bcc6c88395cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:03.241326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6fbd8-017e-4993-9fe7-bcc6c88395cb admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.241718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6fbd8-017e-4993-9fe7-bcc6c88395cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.242052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6fbd8-017e-4993-9fe7-bcc6c88395cb admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.242741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6fbd8-017e-4993-9fe7-bcc6c88395cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:03.244770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6fbd8-017e-4993-9fe7-bcc6c88395cb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:03.267338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1057/2115] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:52:03 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:52:03.272897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37f76-f94d-4ed5-9b3f-2a3dfbdac406 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:03.284225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37f76-f94d-4ed5-9b3f-2a3dfbdac406 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:03.289891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2bf81-6efc-4065-a165-d15097fd1f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:03.290534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2bf81-6efc-4065-a165-d15097fd1f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.290853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2bf81-6efc-4065-a165-d15097fd1f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.291130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2bf81-6efc-4065-a165-d15097fd1f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.291840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2bf81-6efc-4065-a165-d15097fd1f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:03.293484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2bf81-6efc-4065-a165-d15097fd1f2a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:03.304980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1059/2116] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:03.309349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6fbd8-017e-4993-9fe7-bcc6c88395cb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:03.329757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6fbd8-017e-4993-9fe7-bcc6c88395cb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:03.335479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9aa2e-3cda-485b-9f28-609d52d399a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:03.336111 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9aa2e-3cda-485b-9f28-609d52d399a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.336390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9aa2e-3cda-485b-9f28-609d52d399a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.336663 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9aa2e-3cda-485b-9f28-609d52d399a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.337377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9aa2e-3cda-485b-9f28-609d52d399a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:03.339356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9aa2e-3cda-485b-9f28-609d52d399a8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:03.356215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1058/2117] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:52:03.358039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2bf81-6efc-4065-a165-d15097fd1f2a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:03.376193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2bf81-6efc-4065-a165-d15097fd1f2a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:03.381930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f6d19-e0ea-4195-867b-c2c3706a7c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:03.382698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f6d19-e0ea-4195-867b-c2c3706a7c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.383083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f6d19-e0ea-4195-867b-c2c3706a7c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.383430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f6d19-e0ea-4195-867b-c2c3706a7c0c admin admin] PATH_INFO: `/v3/projects/8df50424e82b4badaf118feea3373fbe/users/27f5f944623f4a01b64a299c6b457143/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.402517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f6d19-e0ea-4195-867b-c2c3706a7c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df50424e82b4badaf118feea3373fbe, user_id=27f5f944623f4a01b64a299c6b457143, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:03.405237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f6d19-e0ea-4195-867b-c2c3706a7c0c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:03.420158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1060/2118] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:03 2022] PUT /identity/v3/projects/8df50424e82b4badaf118feea3373fbe/users/27f5f944623f4a01b64a299c6b457143/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:03.431313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759752ec-ca99-4e71-8ad0-05c607119b8b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.432374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759752ec-ca99-4e71-8ad0-05c607119b8b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.432374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759752ec-ca99-4e71-8ad0-05c607119b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.477254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-759752ec-ca99-4e71-8ad0-05c607119b8b None None] MFA Rules not processed for user `27f5f944623f4a01b64a299c6b457143`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:03.478996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-759752ec-ca99-4e71-8ad0-05c607119b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:03.537983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:03.589700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1059/2119] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:03.603204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f6d19-e0ea-4195-867b-c2c3706a7c0c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:03.605239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c75f6d19-e0ea-4195-867b-c2c3706a7c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:03.636544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759752ec-ca99-4e71-8ad0-05c607119b8b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:03.637996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-759752ec-ca99-4e71-8ad0-05c607119b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:03.680962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f6d19-e0ea-4195-867b-c2c3706a7c0c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:03.685466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d105ff-b00c-4b6b-9dd0-ed1d49f8c499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:03.686098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d105ff-b00c-4b6b-9dd0-ed1d49f8c499 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.686382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d105ff-b00c-4b6b-9dd0-ed1d49f8c499 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.686658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d105ff-b00c-4b6b-9dd0-ed1d49f8c499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.696950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d105ff-b00c-4b6b-9dd0-ed1d49f8c499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:03.698506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d105ff-b00c-4b6b-9dd0-ed1d49f8c499 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:03.710258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1061/2120] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:03.743625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759752ec-ca99-4e71-8ad0-05c607119b8b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:03.788135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:03.789061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.789455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.789769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] PATH_INFO: `/v3/users/1282859e0433483088405d2c9201efe0` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.791183 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1282859e0433483088405d2c9201efe0)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:03.793311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:03.889531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1282859e0433483088405d2c9201efe0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:03.922011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1282859e0433483088405d2c9201efe0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:03.922957 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1282859e0433483088405d2c9201efe0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:03.932429 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1282859e0433483088405d2c9201efe0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:03.933232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1282859e0433483088405d2c9201efe0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:03.951668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1060/2121] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:52:03 2022] DELETE /identity/v3/users/1282859e0433483088405d2c9201efe0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:03.956310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88551a1c-0d40-4da1-996d-4a0c58704687 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:03.956606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88551a1c-0d40-4da1-996d-4a0c58704687 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:03.956892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88551a1c-0d40-4da1-996d-4a0c58704687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:03.981916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-88551a1c-0d40-4da1-996d-4a0c58704687 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:03.983175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-88551a1c-0d40-4da1-996d-4a0c58704687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:04.120536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1062/2122] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:52:04.141800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:04.144782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:04.283850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eca49-9a27-4edc-a1cc-e9f22b4687c6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:04.293182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55252c81-7374-46cc-b80b-ac622bc7917b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:04.294219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55252c81-7374-46cc-b80b-ac622bc7917b service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:04.294685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55252c81-7374-46cc-b80b-ac622bc7917b service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:04.294979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55252c81-7374-46cc-b80b-ac622bc7917b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:04.308202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55252c81-7374-46cc-b80b-ac622bc7917b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:04.310907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55252c81-7374-46cc-b80b-ac622bc7917b service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:04.328168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:04.346984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1061/2123] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:04.667516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88551a1c-0d40-4da1-996d-4a0c58704687 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:04.669033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-88551a1c-0d40-4da1-996d-4a0c58704687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:04.681067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:04.705288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88551a1c-0d40-4da1-996d-4a0c58704687 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:04.711634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:04.712457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:04.713902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:04.714283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] PATH_INFO: `/v3/projects/4dddeddd620e47809a6470a0feafb92f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:04.716018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dddeddd620e47809a6470a0feafb92f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:04.718298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:04.778396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dddeddd620e47809a6470a0feafb92f', 'request_id': 'req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:04.787800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dddeddd620e47809a6470a0feafb92f', 'request_id': 'req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:04.793890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dddeddd620e47809a6470a0feafb92f', 'request_id': 'req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:04.813006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] The token cache is being invalidate because project 4dddeddd620e47809a6470a0feafb92f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:52:04.813313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:04.814542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:04.816444 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1063/2124] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:52:04 2022] DELETE /identity/v3/projects/4dddeddd620e47809a6470a0feafb92f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:04.820489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55252c81-7374-46cc-b80b-ac622bc7917b service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:04.847044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55252c81-7374-46cc-b80b-ac622bc7917b service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:04.939553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:04.940210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:04.940489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:04.940762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] PATH_INFO: `/v3/users/ee99d57e3e1a47c2aedbe6a2b5de903c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:04.941989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee99d57e3e1a47c2aedbe6a2b5de903c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:04.944354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:05.000203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee99d57e3e1a47c2aedbe6a2b5de903c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.016561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee99d57e3e1a47c2aedbe6a2b5de903c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.017355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee99d57e3e1a47c2aedbe6a2b5de903c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.025965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee99d57e3e1a47c2aedbe6a2b5de903c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.026704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ac3112c5-c08e-49b7-a03e-131981a8edce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee99d57e3e1a47c2aedbe6a2b5de903c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.041400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1062/2125] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:52:04 2022] DELETE /identity/v3/users/ee99d57e3e1a47c2aedbe6a2b5de903c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:05.350533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:05.352078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:05.369913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab81400-89ec-42cb-9b49-eb3895f1bc1d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:05.512867 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:05.513925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:05.514202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:05.514481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] PATH_INFO: `/v3/projects/d3bb2ba0b7eb46e38b06d29376109bcf` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:05.515745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3bb2ba0b7eb46e38b06d29376109bcf)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:05.517694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:05.652691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3bb2ba0b7eb46e38b06d29376109bcf', 'request_id': 'req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.667471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3bb2ba0b7eb46e38b06d29376109bcf', 'request_id': 'req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.673469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3bb2ba0b7eb46e38b06d29376109bcf', 'request_id': 'req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.684644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] The token cache is being invalidate because project d3bb2ba0b7eb46e38b06d29376109bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:52:05.684918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.685573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4ef01cf-dcdd-4b55-a209-3bc4b6949567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:05.687417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1064/2126] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:52:05 2022] DELETE /identity/v3/projects/d3bb2ba0b7eb46e38b06d29376109bcf => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:05.692106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63084e3-cbcc-4811-826b-7e81ec7a58fd None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:05.692622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63084e3-cbcc-4811-826b-7e81ec7a58fd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:05.692718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63084e3-cbcc-4811-826b-7e81ec7a58fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:05.714215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c63084e3-cbcc-4811-826b-7e81ec7a58fd None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:05.715482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c63084e3-cbcc-4811-826b-7e81ec7a58fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:05.779685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1063/2127] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:05.787483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1cb7b-29ce-4d99-80f2-aa2a091b2e79 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:05.787899 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1cb7b-29ce-4d99-80f2-aa2a091b2e79 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:05.788400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1cb7b-29ce-4d99-80f2-aa2a091b2e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:05.814126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-61f1cb7b-29ce-4d99-80f2-aa2a091b2e79 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:05.815735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-61f1cb7b-29ce-4d99-80f2-aa2a091b2e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:05.824802 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1065/2128] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:05.829170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63084e3-cbcc-4811-826b-7e81ec7a58fd None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:05.840514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63084e3-cbcc-4811-826b-7e81ec7a58fd None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:05.845238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bac18-74b1-431d-b77e-bfb67ab9fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:05.845969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bac18-74b1-431d-b77e-bfb67ab9fddc admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:05.846251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bac18-74b1-431d-b77e-bfb67ab9fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:05.846521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bac18-74b1-431d-b77e-bfb67ab9fddc admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:05.847262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bac18-74b1-431d-b77e-bfb67ab9fddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:52:05.847567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bac18-74b1-431d-b77e-bfb67ab9fddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:05.849450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bac18-74b1-431d-b77e-bfb67ab9fddc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:05.862542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1064/2129] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:52:05.867723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1cb7b-29ce-4d99-80f2-aa2a091b2e79 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:05.882936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1cb7b-29ce-4d99-80f2-aa2a091b2e79 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:05.887807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e98066-5fc9-4504-9558-91148b7b80ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:05.888920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e98066-5fc9-4504-9558-91148b7b80ed admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:05.888920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e98066-5fc9-4504-9558-91148b7b80ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:05.889133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e98066-5fc9-4504-9558-91148b7b80ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:05.889785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e98066-5fc9-4504-9558-91148b7b80ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:05.891810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e98066-5fc9-4504-9558-91148b7b80ed admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:05.908216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:05.927458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1066/2130] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:52:05 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:05.932292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bac18-74b1-431d-b77e-bfb67ab9fddc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:05.942839 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bac18-74b1-431d-b77e-bfb67ab9fddc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:05.949373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:06.009086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f9671-eb81-490b-8aa5-9c1b55baf505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.010446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f9671-eb81-490b-8aa5-9c1b55baf505 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.011387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f9671-eb81-490b-8aa5-9c1b55baf505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.012192 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f9671-eb81-490b-8aa5-9c1b55baf505 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.014841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f9671-eb81-490b-8aa5-9c1b55baf505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.017181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f9671-eb81-490b-8aa5-9c1b55baf505 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.043001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1065/2131] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:52:05 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:06.048313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e98066-5fc9-4504-9558-91148b7b80ed admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.059562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e98066-5fc9-4504-9558-91148b7b80ed admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.065067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459401-2b71-471c-a96e-e1f8c679135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.065687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459401-2b71-471c-a96e-e1f8c679135d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.065966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459401-2b71-471c-a96e-e1f8c679135d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.066242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459401-2b71-471c-a96e-e1f8c679135d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.066981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85459401-2b71-471c-a96e-e1f8c679135d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.069210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85459401-2b71-471c-a96e-e1f8c679135d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.079630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1067/2132] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:52:06.083705 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f9671-eb81-490b-8aa5-9c1b55baf505 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.094653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f9671-eb81-490b-8aa5-9c1b55baf505 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.100395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6860e7-cc8b-44a8-8864-bb5ee577cbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.101038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6860e7-cc8b-44a8-8864-bb5ee577cbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.101467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6860e7-cc8b-44a8-8864-bb5ee577cbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.101662 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6860e7-cc8b-44a8-8864-bb5ee577cbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.102436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6860e7-cc8b-44a8-8864-bb5ee577cbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.104109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6860e7-cc8b-44a8-8864-bb5ee577cbb0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.118647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1066/2133] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:06.119883 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459401-2b71-471c-a96e-e1f8c679135d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.131541 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459401-2b71-471c-a96e-e1f8c679135d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.136530 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70854c-505a-4c68-a9ca-5bfa26e8ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.137210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70854c-505a-4c68-a9ca-5bfa26e8ae53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.137503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70854c-505a-4c68-a9ca-5bfa26e8ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.137784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70854c-505a-4c68-a9ca-5bfa26e8ae53 admin admin] PATH_INFO: `/v3/projects/263e8120d43b400eb15b212118c9e0d7/users/8b04c24caba64e63831bc754a4236723/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.154946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70854c-505a-4c68-a9ca-5bfa26e8ae53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263e8120d43b400eb15b212118c9e0d7, user_id=8b04c24caba64e63831bc754a4236723, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.157633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70854c-505a-4c68-a9ca-5bfa26e8ae53 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.172834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1068/2134] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:06 2022] PUT /identity/v3/projects/263e8120d43b400eb15b212118c9e0d7/users/8b04c24caba64e63831bc754a4236723/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:06.183652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14678639-065e-4616-8201-5a0f71561f95 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.183956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14678639-065e-4616-8201-5a0f71561f95 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.184228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14678639-065e-4616-8201-5a0f71561f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.212821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-14678639-065e-4616-8201-5a0f71561f95 None None] MFA Rules not processed for user `8b04c24caba64e63831bc754a4236723`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:06.214104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-14678639-065e-4616-8201-5a0f71561f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:06.277741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1067/2135] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:06.282391 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70854c-505a-4c68-a9ca-5bfa26e8ae53 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.344636 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70854c-505a-4c68-a9ca-5bfa26e8ae53 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.349559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609f035-dcbc-4e78-a08b-cf41179be39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.350658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609f035-dcbc-4e78-a08b-cf41179be39f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.350967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609f035-dcbc-4e78-a08b-cf41179be39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.351244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609f035-dcbc-4e78-a08b-cf41179be39f admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.351905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609f035-dcbc-4e78-a08b-cf41179be39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.353815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609f035-dcbc-4e78-a08b-cf41179be39f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.380765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1069/2136] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:52:06 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:06.384902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14678639-065e-4616-8201-5a0f71561f95 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.395630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14678639-065e-4616-8201-5a0f71561f95 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.459603 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a4a58-5a9e-48c0-bb71-5581088c1042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.460531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4a58-5a9e-48c0-bb71-5581088c1042 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.460987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4a58-5a9e-48c0-bb71-5581088c1042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.461257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4a58-5a9e-48c0-bb71-5581088c1042 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.461945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a4a58-5a9e-48c0-bb71-5581088c1042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.463995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a4a58-5a9e-48c0-bb71-5581088c1042 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.489597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1068/2137] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:52:06 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:06.495297 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609f035-dcbc-4e78-a08b-cf41179be39f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.507390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609f035-dcbc-4e78-a08b-cf41179be39f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.512359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a98f4-5177-4964-a505-89639540f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.513025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a98f4-5177-4964-a505-89639540f858 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.513310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a98f4-5177-4964-a505-89639540f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.513581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a98f4-5177-4964-a505-89639540f858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.514286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a98f4-5177-4964-a505-89639540f858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.515941 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a98f4-5177-4964-a505-89639540f858 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.527740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1070/2138] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:06.532197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a4a58-5a9e-48c0-bb71-5581088c1042 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.539522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:06.543423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a4a58-5a9e-48c0-bb71-5581088c1042 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.549012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44664e31-13d5-49e1-9f11-adeb18f95e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.549678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664e31-13d5-49e1-9f11-adeb18f95e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.549955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664e31-13d5-49e1-9f11-adeb18f95e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.550229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664e31-13d5-49e1-9f11-adeb18f95e89 admin admin] PATH_INFO: `/v3/projects/3e607cb2abe84bd2a58c0d24a6fa5eb7/users/db492112967949e7854c096d65dae445/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.567470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44664e31-13d5-49e1-9f11-adeb18f95e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e607cb2abe84bd2a58c0d24a6fa5eb7, user_id=db492112967949e7854c096d65dae445, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.570186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44664e31-13d5-49e1-9f11-adeb18f95e89 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.583896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1069/2139] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:06 2022] PUT /identity/v3/projects/3e607cb2abe84bd2a58c0d24a6fa5eb7/users/db492112967949e7854c096d65dae445/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:06.587971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a98f4-5177-4964-a505-89639540f858 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.598062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a98f4-5177-4964-a505-89639540f858 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.665203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb322c7-2a40-431b-80ba-cdeba2f7958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.665904 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb322c7-2a40-431b-80ba-cdeba2f7958a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.666257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb322c7-2a40-431b-80ba-cdeba2f7958a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.666602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb322c7-2a40-431b-80ba-cdeba2f7958a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.667423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb322c7-2a40-431b-80ba-cdeba2f7958a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.669127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb322c7-2a40-431b-80ba-cdeba2f7958a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.680903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1071/2140] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:06.684987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44664e31-13d5-49e1-9f11-adeb18f95e89 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.695845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44664e31-13d5-49e1-9f11-adeb18f95e89 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.701663 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f94da8-ee4a-489f-862e-8953720a1bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.702360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f94da8-ee4a-489f-862e-8953720a1bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.702647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f94da8-ee4a-489f-862e-8953720a1bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.702947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f94da8-ee4a-489f-862e-8953720a1bf3 admin admin] PATH_INFO: `/v3/projects/3e607cb2abe84bd2a58c0d24a6fa5eb7/users/db492112967949e7854c096d65dae445/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.705061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f94da8-ee4a-489f-862e-8953720a1bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e607cb2abe84bd2a58c0d24a6fa5eb7, user_id=db492112967949e7854c096d65dae445, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:06.707894 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f94da8-ee4a-489f-862e-8953720a1bf3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:06.725658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1070/2141] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:06 2022] PUT /identity/v3/projects/3e607cb2abe84bd2a58c0d24a6fa5eb7/users/db492112967949e7854c096d65dae445/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:06.732564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350c695-aa56-48ac-af4f-0971505c6a13 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.733122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350c695-aa56-48ac-af4f-0971505c6a13 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.733561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350c695-aa56-48ac-af4f-0971505c6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:06.766987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5350c695-aa56-48ac-af4f-0971505c6a13 None None] MFA Rules not processed for user `db492112967949e7854c096d65dae445`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:06.768657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5350c695-aa56-48ac-af4f-0971505c6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:06.801962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:06.911728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1072/2142] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:06.923697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f94da8-ee4a-489f-862e-8953720a1bf3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:06.925461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-71f94da8-ee4a-489f-862e-8953720a1bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:06.993054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f94da8-ee4a-489f-862e-8953720a1bf3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:06.996799 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e34a7-06e6-466a-97dd-140ec340d49b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:06.997509 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e34a7-06e6-466a-97dd-140ec340d49b service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:06.997851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e34a7-06e6-466a-97dd-140ec340d49b service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:06.998197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e34a7-06e6-466a-97dd-140ec340d49b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:07.008714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e34a7-06e6-466a-97dd-140ec340d49b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:07.010269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e34a7-06e6-466a-97dd-140ec340d49b service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:07.021001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1071/2143] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:07.058534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350c695-aa56-48ac-af4f-0971505c6a13 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:07.129647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350c695-aa56-48ac-af4f-0971505c6a13 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:07.134801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:07.135479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:07.135759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:07.145438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] PATH_INFO: `/v3/users/8b04c24caba64e63831bc754a4236723` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:07.148501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b04c24caba64e63831bc754a4236723)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:07.151707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:07.216760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b04c24caba64e63831bc754a4236723'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.230868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b04c24caba64e63831bc754a4236723'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.265649 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b04c24caba64e63831bc754a4236723'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.266527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b04c24caba64e63831bc754a4236723'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.289790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b04c24caba64e63831bc754a4236723'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.312322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1073/2144] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:52:07 2022] DELETE /identity/v3/users/8b04c24caba64e63831bc754a4236723 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:07.313994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f5cc0-a7fc-4898-bd87-29ef514eae4b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:07.313994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f5cc0-a7fc-4898-bd87-29ef514eae4b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:07.314273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f5cc0-a7fc-4898-bd87-29ef514eae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:07.355770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-075f5cc0-a7fc-4898-bd87-29ef514eae4b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:07.356141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-075f5cc0-a7fc-4898-bd87-29ef514eae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:07.444358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1072/2145] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:07.454081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:07.455615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:07.492706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:07.521294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fec051-0953-4c35-9a4a-7efccd435266 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:07.525443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25577e32-337b-495d-9abb-b6b00fd88c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:07.526077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25577e32-337b-495d-9abb-b6b00fd88c13 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:07.526365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25577e32-337b-495d-9abb-b6b00fd88c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:07.526626 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25577e32-337b-495d-9abb-b6b00fd88c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:07.535954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25577e32-337b-495d-9abb-b6b00fd88c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:07.537389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25577e32-337b-495d-9abb-b6b00fd88c13 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:07.548165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1074/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:07.823435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f5cc0-a7fc-4898-bd87-29ef514eae4b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:07.825092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-075f5cc0-a7fc-4898-bd87-29ef514eae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:07.838599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f5cc0-a7fc-4898-bd87-29ef514eae4b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:07.844144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:07.844866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:07.845207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:07.845545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] PATH_INFO: `/v3/projects/263e8120d43b400eb15b212118c9e0d7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:07.854375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263e8120d43b400eb15b212118c9e0d7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:07.856364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:07.908551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263e8120d43b400eb15b212118c9e0d7', 'request_id': 'req-d5807ace-4b44-4493-82af-8a67060d7b59'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.917543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263e8120d43b400eb15b212118c9e0d7', 'request_id': 'req-d5807ace-4b44-4493-82af-8a67060d7b59'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.925203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263e8120d43b400eb15b212118c9e0d7', 'request_id': 'req-d5807ace-4b44-4493-82af-8a67060d7b59'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.928300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:07.938161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] The token cache is being invalidate because project 263e8120d43b400eb15b212118c9e0d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:52:07.938706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.939948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:07.941680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1073/2147] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:52:07 2022] DELETE /identity/v3/projects/263e8120d43b400eb15b212118c9e0d7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:07.946162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25577e32-337b-495d-9abb-b6b00fd88c13 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:07.956093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25577e32-337b-495d-9abb-b6b00fd88c13 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:08.016123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:08.016772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.017051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.017366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] PATH_INFO: `/v3/users/db492112967949e7854c096d65dae445` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.018512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db492112967949e7854c096d65dae445)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:08.020490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:08.072423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db492112967949e7854c096d65dae445'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.079222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db492112967949e7854c096d65dae445'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.090742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db492112967949e7854c096d65dae445'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.091396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db492112967949e7854c096d65dae445'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.097981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24f8f600-05a8-4cdc-9135-d4135e250b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db492112967949e7854c096d65dae445'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.104529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1075/2148] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:52:07 2022] DELETE /identity/v3/users/db492112967949e7854c096d65dae445 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:08.378228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:08.379970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:08.405978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807ace-4b44-4493-82af-8a67060d7b59 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:08.472933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:08.475108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.475880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.476154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] PATH_INFO: `/v3/projects/3e607cb2abe84bd2a58c0d24a6fa5eb7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.477476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e607cb2abe84bd2a58c0d24a6fa5eb7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:08.479497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:08.536144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e607cb2abe84bd2a58c0d24a6fa5eb7', 'request_id': 'req-c5f0f5e8-4202-4884-85a4-95c278ffd04a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.543765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e607cb2abe84bd2a58c0d24a6fa5eb7', 'request_id': 'req-c5f0f5e8-4202-4884-85a4-95c278ffd04a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.549730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e607cb2abe84bd2a58c0d24a6fa5eb7', 'request_id': 'req-c5f0f5e8-4202-4884-85a4-95c278ffd04a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.561058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] The token cache is being invalidate because project 3e607cb2abe84bd2a58c0d24a6fa5eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:52:08.561349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.561994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c5f0f5e8-4202-4884-85a4-95c278ffd04a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:08.563604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1074/2149] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:52:08 2022] DELETE /identity/v3/projects/3e607cb2abe84bd2a58c0d24a6fa5eb7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:08.569259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4ed19-7c6f-42af-981c-b3d67d469209 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.569556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4ed19-7c6f-42af-981c-b3d67d469209 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.569858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4ed19-7c6f-42af-981c-b3d67d469209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.590217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-71a4ed19-7c6f-42af-981c-b3d67d469209 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:08.591458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71a4ed19-7c6f-42af-981c-b3d67d469209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:08.637473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:08.654041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1076/2150] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:08.663084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c30d1c-857b-4b5a-b52c-5a028cd424dc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.663373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c30d1c-857b-4b5a-b52c-5a028cd424dc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.663653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c30d1c-857b-4b5a-b52c-5a028cd424dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.683630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-10c30d1c-857b-4b5a-b52c-5a028cd424dc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:08.684881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-10c30d1c-857b-4b5a-b52c-5a028cd424dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:08.693062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1075/2151] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:08.697930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4ed19-7c6f-42af-981c-b3d67d469209 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:08.708078 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4ed19-7c6f-42af-981c-b3d67d469209 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:08.713519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf45b8-51ca-4496-b14a-63cb9cc63edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:08.714110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf45b8-51ca-4496-b14a-63cb9cc63edb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.714358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf45b8-51ca-4496-b14a-63cb9cc63edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.714633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf45b8-51ca-4496-b14a-63cb9cc63edb admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.715364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf45b8-51ca-4496-b14a-63cb9cc63edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:52:08.715671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf45b8-51ca-4496-b14a-63cb9cc63edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:08.717266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf45b8-51ca-4496-b14a-63cb9cc63edb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:08.729195 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1077/2152] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:52:08.733468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c30d1c-857b-4b5a-b52c-5a028cd424dc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:08.742998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c30d1c-857b-4b5a-b52c-5a028cd424dc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:08.747654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196e7a1-beb5-4de7-8dcc-39798c612eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:08.748252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196e7a1-beb5-4de7-8dcc-39798c612eee admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.748528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196e7a1-beb5-4de7-8dcc-39798c612eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.748794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196e7a1-beb5-4de7-8dcc-39798c612eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.749457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196e7a1-beb5-4de7-8dcc-39798c612eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:08.751374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196e7a1-beb5-4de7-8dcc-39798c612eee admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:08.778393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1076/2153] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:52:08 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:08.783454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf45b8-51ca-4496-b14a-63cb9cc63edb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:08.793854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf45b8-51ca-4496-b14a-63cb9cc63edb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:08.852501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3174e-261f-4833-98e5-132310102a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:08.853115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3174e-261f-4833-98e5-132310102a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.853398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3174e-261f-4833-98e5-132310102a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.853673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3174e-261f-4833-98e5-132310102a1c admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.854347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3174e-261f-4833-98e5-132310102a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:08.856302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3174e-261f-4833-98e5-132310102a1c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:08.877359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1078/2154] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:52:08 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:08.881960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196e7a1-beb5-4de7-8dcc-39798c612eee admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:08.892787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196e7a1-beb5-4de7-8dcc-39798c612eee admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:08.898116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8442ac3-4f05-461f-9d7c-4a7d65929398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:08.898797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8442ac3-4f05-461f-9d7c-4a7d65929398 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.899106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8442ac3-4f05-461f-9d7c-4a7d65929398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.899378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8442ac3-4f05-461f-9d7c-4a7d65929398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.900074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8442ac3-4f05-461f-9d7c-4a7d65929398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:08.901682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8442ac3-4f05-461f-9d7c-4a7d65929398 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:08.913125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1077/2155] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:08.917211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3174e-261f-4833-98e5-132310102a1c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:08.927289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3174e-261f-4833-98e5-132310102a1c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:08.931956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d683c-834d-442d-a4d8-1911115c1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:08.932566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d683c-834d-442d-a4d8-1911115c1533 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.932850 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d683c-834d-442d-a4d8-1911115c1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.933127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d683c-834d-442d-a4d8-1911115c1533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.933827 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d683c-834d-442d-a4d8-1911115c1533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:08.935491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d683c-834d-442d-a4d8-1911115c1533 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:08.946096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1079/2156] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:08.950293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8442ac3-4f05-461f-9d7c-4a7d65929398 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:08.961014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8442ac3-4f05-461f-9d7c-4a7d65929398 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:08.965740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6718-aae7-4370-85c5-8224583f95fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:08.966335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6718-aae7-4370-85c5-8224583f95fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:08.966617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6718-aae7-4370-85c5-8224583f95fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:08.966906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6718-aae7-4370-85c5-8224583f95fa admin admin] PATH_INFO: `/v3/projects/3e13d50ad8a0436bbcc0c802469e5107/users/94512c5daa5e4e09b26edec31aeccb03/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:08.982187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6718-aae7-4370-85c5-8224583f95fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e13d50ad8a0436bbcc0c802469e5107, user_id=94512c5daa5e4e09b26edec31aeccb03, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:08.984887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6718-aae7-4370-85c5-8224583f95fa admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:08.997796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1078/2157] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:08 2022] PUT /identity/v3/projects/3e13d50ad8a0436bbcc0c802469e5107/users/94512c5daa5e4e09b26edec31aeccb03/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:09.008610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1694-4402-4619-ab0a-bbb9a3379ac4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:09.009099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1694-4402-4619-ab0a-bbb9a3379ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:09.009192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1694-4402-4619-ab0a-bbb9a3379ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:09.038359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0a5a1694-4402-4619-ab0a-bbb9a3379ac4 None None] MFA Rules not processed for user `94512c5daa5e4e09b26edec31aeccb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:09.039619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0a5a1694-4402-4619-ab0a-bbb9a3379ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:09.104592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1080/2158] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:09.116531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6718-aae7-4370-85c5-8224583f95fa admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:09.118240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-56ff6718-aae7-4370-85c5-8224583f95fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:09.140395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:09.181163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6718-aae7-4370-85c5-8224583f95fa admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:09.185132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed18898-42ec-4aa4-a3c7-c934de96d9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:09.185749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed18898-42ec-4aa4-a3c7-c934de96d9aa service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:09.186024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed18898-42ec-4aa4-a3c7-c934de96d9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:09.186293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed18898-42ec-4aa4-a3c7-c934de96d9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:09.195363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed18898-42ec-4aa4-a3c7-c934de96d9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:09.196978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed18898-42ec-4aa4-a3c7-c934de96d9aa service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:09.206843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1079/2159] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:09.229410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1694-4402-4619-ab0a-bbb9a3379ac4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:09.276756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:09.292668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1694-4402-4619-ab0a-bbb9a3379ac4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:09.297342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:09.298015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:09.298299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:09.298578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] PATH_INFO: `/v3/users/94512c5daa5e4e09b26edec31aeccb03` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:09.299792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94512c5daa5e4e09b26edec31aeccb03)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:09.301735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:09.348998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94512c5daa5e4e09b26edec31aeccb03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:09.355951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94512c5daa5e4e09b26edec31aeccb03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:09.367964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94512c5daa5e4e09b26edec31aeccb03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:09.368620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94512c5daa5e4e09b26edec31aeccb03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:09.375279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94512c5daa5e4e09b26edec31aeccb03'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:09.381571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1081/2160] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:52:09 2022] DELETE /identity/v3/users/94512c5daa5e4e09b26edec31aeccb03 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:09.386227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc113a-fb33-4002-98e2-ec3e426453ad None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:09.386518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc113a-fb33-4002-98e2-ec3e426453ad None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:09.386845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc113a-fb33-4002-98e2-ec3e426453ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:09.407227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-30cc113a-fb33-4002-98e2-ec3e426453ad None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:09.408460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-30cc113a-fb33-4002-98e2-ec3e426453ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:09.469528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1080/2161] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:52:09.479325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:09.480712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:09.541968 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a86d-2b55-4395-a4f8-5dcae5e1bf01 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:09.545871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abfc65-3c24-4840-bdcb-43525db6f060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:09.546515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abfc65-3c24-4840-bdcb-43525db6f060 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:09.546797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abfc65-3c24-4840-bdcb-43525db6f060 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:09.547106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abfc65-3c24-4840-bdcb-43525db6f060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:09.558430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abfc65-3c24-4840-bdcb-43525db6f060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:09.560013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abfc65-3c24-4840-bdcb-43525db6f060 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:09.573547 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1082/2162] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:09.884236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc113a-fb33-4002-98e2-ec3e426453ad None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:09.886293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-30cc113a-fb33-4002-98e2-ec3e426453ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:09.898929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc113a-fb33-4002-98e2-ec3e426453ad None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:09.905194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:09.906085 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:09.906439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:09.906784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] PATH_INFO: `/v3/projects/3e13d50ad8a0436bbcc0c802469e5107` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:09.908290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e13d50ad8a0436bbcc0c802469e5107)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:09.910610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:09.974268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e13d50ad8a0436bbcc0c802469e5107', 'request_id': 'req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:09.982688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e13d50ad8a0436bbcc0c802469e5107', 'request_id': 'req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:09.988753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e13d50ad8a0436bbcc0c802469e5107', 'request_id': 'req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:10.000810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] The token cache is being invalidate because project 3e13d50ad8a0436bbcc0c802469e5107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:52:10.001095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:10.001758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e001b9ee-9862-4d6e-aefc-ca584eb0ce48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:10.003552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1081/2163] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:52:09 2022] DELETE /identity/v3/projects/3e13d50ad8a0436bbcc0c802469e5107 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:10.009028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439f3c-8beb-4220-ab5d-30b4ed927745 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.009549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439f3c-8beb-4220-ab5d-30b4ed927745 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.009760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439f3c-8beb-4220-ab5d-30b4ed927745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.036396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a8439f3c-8beb-4220-ab5d-30b4ed927745 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:10.038126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a8439f3c-8beb-4220-ab5d-30b4ed927745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:10.112214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1083/2164] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:10.121538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b2417-75b4-4a74-ac48-bf5885b45d73 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.121872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b2417-75b4-4a74-ac48-bf5885b45d73 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.122214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b2417-75b4-4a74-ac48-bf5885b45d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.145665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eb2b2417-75b4-4a74-ac48-bf5885b45d73 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:10.147073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eb2b2417-75b4-4a74-ac48-bf5885b45d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:10.156374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1082/2165] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:10.160767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8439f3c-8beb-4220-ab5d-30b4ed927745 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:10.173292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8439f3c-8beb-4220-ab5d-30b4ed927745 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:10.178558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5e97-d0de-4bb4-88ff-ee948509a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:10.179214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5e97-d0de-4bb4-88ff-ee948509a8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.179494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5e97-d0de-4bb4-88ff-ee948509a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.179767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5e97-d0de-4bb4-88ff-ee948509a8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.180471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5e97-d0de-4bb4-88ff-ee948509a8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:52:10.180774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5e97-d0de-4bb4-88ff-ee948509a8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:10.182385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5e97-d0de-4bb4-88ff-ee948509a8e3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:10.185104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:10.201326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1084/2166] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:52:10.201626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b2417-75b4-4a74-ac48-bf5885b45d73 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:10.211813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b2417-75b4-4a74-ac48-bf5885b45d73 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:10.216630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb902e8-78ca-41c3-9d98-af0dbae6c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:10.217265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb902e8-78ca-41c3-9d98-af0dbae6c890 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.217544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb902e8-78ca-41c3-9d98-af0dbae6c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.217816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb902e8-78ca-41c3-9d98-af0dbae6c890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.218519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb902e8-78ca-41c3-9d98-af0dbae6c890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:10.220486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb902e8-78ca-41c3-9d98-af0dbae6c890 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:10.261362 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1083/2167] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:52:10 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:52:10.262426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5e97-d0de-4bb4-88ff-ee948509a8e3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:10.273258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5e97-d0de-4bb4-88ff-ee948509a8e3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:10.361140 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598ceea-98cb-42b5-91f9-7bc40015fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:10.362093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598ceea-98cb-42b5-91f9-7bc40015fe61 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.362615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598ceea-98cb-42b5-91f9-7bc40015fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.363382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598ceea-98cb-42b5-91f9-7bc40015fe61 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.364266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598ceea-98cb-42b5-91f9-7bc40015fe61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:10.368175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598ceea-98cb-42b5-91f9-7bc40015fe61 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:10.391706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1085/2168] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:52:10 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:10.395727 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb902e8-78ca-41c3-9d98-af0dbae6c890 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:10.407095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb902e8-78ca-41c3-9d98-af0dbae6c890 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:10.430179 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b5270-2640-4939-8128-e7b166c276e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:10.430833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5270-2640-4939-8128-e7b166c276e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.431198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5270-2640-4939-8128-e7b166c276e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.431472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5270-2640-4939-8128-e7b166c276e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.432328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b5270-2640-4939-8128-e7b166c276e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:10.434143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b5270-2640-4939-8128-e7b166c276e6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:10.446333 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1084/2169] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:10.451291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598ceea-98cb-42b5-91f9-7bc40015fe61 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:10.464334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598ceea-98cb-42b5-91f9-7bc40015fe61 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:10.469264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118938e2-f7ca-4d29-879c-40769f43293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:10.469961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118938e2-f7ca-4d29-879c-40769f43293a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.470311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118938e2-f7ca-4d29-879c-40769f43293a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.470652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118938e2-f7ca-4d29-879c-40769f43293a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.471460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118938e2-f7ca-4d29-879c-40769f43293a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:10.473154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118938e2-f7ca-4d29-879c-40769f43293a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:10.487490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1086/2170] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:10.492435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b5270-2640-4939-8128-e7b166c276e6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:10.502935 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b5270-2640-4939-8128-e7b166c276e6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:10.508380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e7f2f-ed7e-423b-8462-95c0b3d76f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:10.509063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e7f2f-ed7e-423b-8462-95c0b3d76f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.509344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e7f2f-ed7e-423b-8462-95c0b3d76f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.509650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e7f2f-ed7e-423b-8462-95c0b3d76f07 admin admin] PATH_INFO: `/v3/projects/1c71a9b128fd4979b27108fd5a13d43c/users/235a75d2f20a41f4be5e18ffe4b6eed4/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.512170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:10.528404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e7f2f-ed7e-423b-8462-95c0b3d76f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c71a9b128fd4979b27108fd5a13d43c, user_id=235a75d2f20a41f4be5e18ffe4b6eed4, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:10.531257 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e7f2f-ed7e-423b-8462-95c0b3d76f07 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:10.547028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1085/2171] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:10 2022] PUT /identity/v3/projects/1c71a9b128fd4979b27108fd5a13d43c/users/235a75d2f20a41f4be5e18ffe4b6eed4/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:10.559013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f5133-ac59-4b26-8a7c-a3eae07c5be7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.559416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f5133-ac59-4b26-8a7c-a3eae07c5be7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.559764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f5133-ac59-4b26-8a7c-a3eae07c5be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.589926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-206f5133-ac59-4b26-8a7c-a3eae07c5be7 None None] MFA Rules not processed for user `235a75d2f20a41f4be5e18ffe4b6eed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:10.591194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-206f5133-ac59-4b26-8a7c-a3eae07c5be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:10.658436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1087/2172] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:10.669360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e7f2f-ed7e-423b-8462-95c0b3d76f07 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:10.671097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c53e7f2f-ed7e-423b-8462-95c0b3d76f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:10.726471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e7f2f-ed7e-423b-8462-95c0b3d76f07 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:10.730103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c857d99-be68-4266-a43a-95e0b6ed73ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7a3c5f6b9645fb8cd2a65cee4f37c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:10.730707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857d99-be68-4266-a43a-95e0b6ed73ef service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:10.731013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857d99-be68-4266-a43a-95e0b6ed73ef service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:10.731282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857d99-be68-4266-a43a-95e0b6ed73ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:10.739739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c857d99-be68-4266-a43a-95e0b6ed73ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:10.741615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c857d99-be68-4266-a43a-95e0b6ed73ef service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:10.751762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1086/2173] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:20.655616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:20.747415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:35.887809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f5133-ac59-4b26-8a7c-a3eae07c5be7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:35.889348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-206f5133-ac59-4b26-8a7c-a3eae07c5be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:35.953583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f5133-ac59-4b26-8a7c-a3eae07c5be7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:35.958041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:35.958676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:35.958981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:35.959251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] PATH_INFO: `/v3/users/27f5f944623f4a01b64a299c6b457143` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:35.960401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f5f944623f4a01b64a299c6b457143)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:35.962349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:36.009957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f5f944623f4a01b64a299c6b457143'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.016839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f5f944623f4a01b64a299c6b457143'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.029075 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f5f944623f4a01b64a299c6b457143'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.029735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f5f944623f4a01b64a299c6b457143'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.036531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f5f944623f4a01b64a299c6b457143'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.042914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1088/2174] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:52:35 2022] DELETE /identity/v3/users/27f5f944623f4a01b64a299c6b457143 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:36.047552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363c68f-02be-4cac-af50-93a6e1f61d7c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:36.048058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363c68f-02be-4cac-af50-93a6e1f61d7c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:36.048142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363c68f-02be-4cac-af50-93a6e1f61d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:36.068147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d363c68f-02be-4cac-af50-93a6e1f61d7c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:36.069391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d363c68f-02be-4cac-af50-93a6e1f61d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:36.130321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1087/2175] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:36.140204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:36.141911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:36.204206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfda059-afbb-4ce1-b55d-c2c7e31cc918 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:36.208085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088f9b6-c7f9-4ccb-a55e-8ba9252e7284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:36.208710 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088f9b6-c7f9-4ccb-a55e-8ba9252e7284 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:36.208993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088f9b6-c7f9-4ccb-a55e-8ba9252e7284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:36.209267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088f9b6-c7f9-4ccb-a55e-8ba9252e7284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:36.219091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088f9b6-c7f9-4ccb-a55e-8ba9252e7284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:36.220546 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088f9b6-c7f9-4ccb-a55e-8ba9252e7284 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:36.231131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1089/2176] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:36.591512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363c68f-02be-4cac-af50-93a6e1f61d7c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:36.592969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d363c68f-02be-4cac-af50-93a6e1f61d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:36.615493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363c68f-02be-4cac-af50-93a6e1f61d7c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:36.622502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:36.623372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:36.623743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:36.624097 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] PATH_INFO: `/v3/projects/8df50424e82b4badaf118feea3373fbe` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:36.626373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df50424e82b4badaf118feea3373fbe)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:36.628632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:36.684341 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df50424e82b4badaf118feea3373fbe', 'request_id': 'req-52489cda-46b4-4dbe-b563-b108e0c204e5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.691959 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df50424e82b4badaf118feea3373fbe', 'request_id': 'req-52489cda-46b4-4dbe-b563-b108e0c204e5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.700549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df50424e82b4badaf118feea3373fbe', 'request_id': 'req-52489cda-46b4-4dbe-b563-b108e0c204e5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.713037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] The token cache is being invalidate because project 8df50424e82b4badaf118feea3373fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:52:36.713328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.713992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52489cda-46b4-4dbe-b563-b108e0c204e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:36.715557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1088/2177] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:52:36 2022] DELETE /identity/v3/projects/8df50424e82b4badaf118feea3373fbe => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:36.720583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dde69-71ae-4103-913f-f5f6db3e0398 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:36.720879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dde69-71ae-4103-913f-f5f6db3e0398 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:36.721156 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dde69-71ae-4103-913f-f5f6db3e0398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:36.742046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d72dde69-71ae-4103-913f-f5f6db3e0398 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:36.743478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d72dde69-71ae-4103-913f-f5f6db3e0398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:36.762632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:36.808460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1090/2178] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:36.816535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d989c-b360-4be7-b78f-7677364c605e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:36.816824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d989c-b360-4be7-b78f-7677364c605e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:36.817106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d989c-b360-4be7-b78f-7677364c605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:36.836734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-081d989c-b360-4be7-b78f-7677364c605e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:36.838446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-081d989c-b360-4be7-b78f-7677364c605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:36.846479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1089/2179] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:36.851068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dde69-71ae-4103-913f-f5f6db3e0398 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:36.861338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dde69-71ae-4103-913f-f5f6db3e0398 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:36.865933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ae5a3-5a3c-4ef5-b433-b7a61b5a2080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:36.866542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ae5a3-5a3c-4ef5-b433-b7a61b5a2080 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:36.866819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ae5a3-5a3c-4ef5-b433-b7a61b5a2080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:36.867126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ae5a3-5a3c-4ef5-b433-b7a61b5a2080 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:36.867816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ae5a3-5a3c-4ef5-b433-b7a61b5a2080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:52:36.868118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ae5a3-5a3c-4ef5-b433-b7a61b5a2080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:36.870472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ae5a3-5a3c-4ef5-b433-b7a61b5a2080 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:36.883732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1091/2180] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:52:36.888677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d989c-b360-4be7-b78f-7677364c605e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:36.898371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d989c-b360-4be7-b78f-7677364c605e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:36.903702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1943e-929b-4cbd-a25d-8f0f784934e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:36.904323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1943e-929b-4cbd-a25d-8f0f784934e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:36.904622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1943e-929b-4cbd-a25d-8f0f784934e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:36.904905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1943e-929b-4cbd-a25d-8f0f784934e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:36.905590 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1943e-929b-4cbd-a25d-8f0f784934e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:36.907594 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1943e-929b-4cbd-a25d-8f0f784934e1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:36.938698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1090/2181] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:52:36 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:36.942947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ae5a3-5a3c-4ef5-b433-b7a61b5a2080 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:36.954494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ae5a3-5a3c-4ef5-b433-b7a61b5a2080 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:37.015536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a28fe-5261-4400-bd04-67f2e4ed9235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:37.016160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a28fe-5261-4400-bd04-67f2e4ed9235 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:37.016436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a28fe-5261-4400-bd04-67f2e4ed9235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:37.016709 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a28fe-5261-4400-bd04-67f2e4ed9235 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:37.017386 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a28fe-5261-4400-bd04-67f2e4ed9235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:37.019470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a28fe-5261-4400-bd04-67f2e4ed9235 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:37.052554 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1092/2182] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:52:36 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:52:37.056473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1943e-929b-4cbd-a25d-8f0f784934e1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:37.067308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1943e-929b-4cbd-a25d-8f0f784934e1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:37.073615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355532e8-4402-41dd-be19-09497cc47624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:37.074307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355532e8-4402-41dd-be19-09497cc47624 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:37.074600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355532e8-4402-41dd-be19-09497cc47624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:37.074973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355532e8-4402-41dd-be19-09497cc47624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:37.075692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355532e8-4402-41dd-be19-09497cc47624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:37.077347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355532e8-4402-41dd-be19-09497cc47624 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:37.091861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1091/2183] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:52:37.093006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a28fe-5261-4400-bd04-67f2e4ed9235 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:37.104424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a28fe-5261-4400-bd04-67f2e4ed9235 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:37.110026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1091a-586f-4688-99e2-1dea631d9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:37.110646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1091a-586f-4688-99e2-1dea631d9eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:37.110978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1091a-586f-4688-99e2-1dea631d9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:37.111235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1091a-586f-4688-99e2-1dea631d9eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:37.111937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1091a-586f-4688-99e2-1dea631d9eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:37.113647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1091a-586f-4688-99e2-1dea631d9eb6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:37.124596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1093/2184] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:37.128927 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355532e8-4402-41dd-be19-09497cc47624 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:37.138944 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355532e8-4402-41dd-be19-09497cc47624 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:37.143519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a528e1-3876-4529-8faf-3c8e3ff878af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:37.144174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a528e1-3876-4529-8faf-3c8e3ff878af admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:37.144454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a528e1-3876-4529-8faf-3c8e3ff878af admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:37.144726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a528e1-3876-4529-8faf-3c8e3ff878af admin admin] PATH_INFO: `/v3/projects/479f452a345b4c219d32d2ad78183af6/users/5efb3ea424f8450c883d4757545af18d/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:37.160546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a528e1-3876-4529-8faf-3c8e3ff878af admin admin] RBAC: Authorizing `identity:create_grant(project_id=479f452a345b4c219d32d2ad78183af6, user_id=5efb3ea424f8450c883d4757545af18d, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:37.163240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a528e1-3876-4529-8faf-3c8e3ff878af admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:37.177174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1092/2185] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:37 2022] PUT /identity/v3/projects/479f452a345b4c219d32d2ad78183af6/users/5efb3ea424f8450c883d4757545af18d/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:37.182237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a666-8d41-414a-947c-f8af72a78ad1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:37.182556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a666-8d41-414a-947c-f8af72a78ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:37.182839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a666-8d41-414a-947c-f8af72a78ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:37.204342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0021a666-8d41-414a-947c-f8af72a78ad1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:37.205569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0021a666-8d41-414a-947c-f8af72a78ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:37.266044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1094/2186] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:37.276236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a528e1-3876-4529-8faf-3c8e3ff878af admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:37.277991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-24a528e1-3876-4529-8faf-3c8e3ff878af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:37.299959 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:37.339670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a528e1-3876-4529-8faf-3c8e3ff878af admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:37.343545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f402cf-4d59-4ca7-85ab-51617c0d02a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:37.344287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f402cf-4d59-4ca7-85ab-51617c0d02a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:37.344561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f402cf-4d59-4ca7-85ab-51617c0d02a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:37.344838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f402cf-4d59-4ca7-85ab-51617c0d02a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:37.355523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f402cf-4d59-4ca7-85ab-51617c0d02a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:37.357266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f402cf-4d59-4ca7-85ab-51617c0d02a6 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:37.367642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1093/2187] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:37.986252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a666-8d41-414a-947c-f8af72a78ad1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:37.988614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0021a666-8d41-414a-947c-f8af72a78ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:38.024516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:38.068303 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a666-8d41-414a-947c-f8af72a78ad1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:38.074447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc10079-7d9f-47ec-a8bb-2207d18b67ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:38.075095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10079-7d9f-47ec-a8bb-2207d18b67ac service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:38.075398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10079-7d9f-47ec-a8bb-2207d18b67ac service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:38.075671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10079-7d9f-47ec-a8bb-2207d18b67ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:38.080109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-acc10079-7d9f-47ec-a8bb-2207d18b67ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:38.093456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc10079-7d9f-47ec-a8bb-2207d18b67ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:38.095257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc10079-7d9f-47ec-a8bb-2207d18b67ac service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:38.123570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1095/2188] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:42.554044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498617-8b04-4f4d-82d1-c97fc512e2cb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:42.554638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498617-8b04-4f4d-82d1-c97fc512e2cb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:42.554638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498617-8b04-4f4d-82d1-c97fc512e2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:42.588499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ef498617-8b04-4f4d-82d1-c97fc512e2cb None None] MFA Rules not processed for user `5efb3ea424f8450c883d4757545af18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:42.589806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ef498617-8b04-4f4d-82d1-c97fc512e2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:42.667899 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1094/2189] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:42.672159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc10079-7d9f-47ec-a8bb-2207d18b67ac service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:42.685315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc10079-7d9f-47ec-a8bb-2207d18b67ac service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:42.690299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a594e8-ea76-48c6-8cc5-37389298a584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:42.690957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a594e8-ea76-48c6-8cc5-37389298a584 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:42.691241 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a594e8-ea76-48c6-8cc5-37389298a584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:42.691518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a594e8-ea76-48c6-8cc5-37389298a584 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:42.692206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a594e8-ea76-48c6-8cc5-37389298a584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:42.694246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a594e8-ea76-48c6-8cc5-37389298a584 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:42.734981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1096/2190] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:52:42 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:52:42.738527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef498617-8b04-4f4d-82d1-c97fc512e2cb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:42.751890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef498617-8b04-4f4d-82d1-c97fc512e2cb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:42.825346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fb10c-9548-4732-b54d-8931f3ac7144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:42.826055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fb10c-9548-4732-b54d-8931f3ac7144 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:42.826269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fb10c-9548-4732-b54d-8931f3ac7144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:42.826636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fb10c-9548-4732-b54d-8931f3ac7144 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:42.827246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fb10c-9548-4732-b54d-8931f3ac7144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:42.829189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fb10c-9548-4732-b54d-8931f3ac7144 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:42.855703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1095/2191] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:52:42 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:42.859780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a594e8-ea76-48c6-8cc5-37389298a584 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:42.874593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a594e8-ea76-48c6-8cc5-37389298a584 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:42.879736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76281d-3711-44e5-a09f-ebfec1167f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:42.880368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76281d-3711-44e5-a09f-ebfec1167f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:42.880886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76281d-3711-44e5-a09f-ebfec1167f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:42.881224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76281d-3711-44e5-a09f-ebfec1167f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:42.881933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76281d-3711-44e5-a09f-ebfec1167f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:42.883607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76281d-3711-44e5-a09f-ebfec1167f4c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:42.896208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1097/2192] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:42.899828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fb10c-9548-4732-b54d-8931f3ac7144 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:42.911313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fb10c-9548-4732-b54d-8931f3ac7144 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:42.916825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e43e2b-4f70-4015-a644-e34f3d3b842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:42.917510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e43e2b-4f70-4015-a644-e34f3d3b842e admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:42.917793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e43e2b-4f70-4015-a644-e34f3d3b842e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:42.918070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e43e2b-4f70-4015-a644-e34f3d3b842e admin admin] PATH_INFO: `/v3/projects/bc325b50f2a84949b5d97a80215eae8e/users/91de80583d3446799cd6256e3115fa16/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:42.939176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e43e2b-4f70-4015-a644-e34f3d3b842e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc325b50f2a84949b5d97a80215eae8e, user_id=91de80583d3446799cd6256e3115fa16, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:42.942280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e43e2b-4f70-4015-a644-e34f3d3b842e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:42.958293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1096/2193] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:42 2022] PUT /identity/v3/projects/bc325b50f2a84949b5d97a80215eae8e/users/91de80583d3446799cd6256e3115fa16/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:42.962277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76281d-3711-44e5-a09f-ebfec1167f4c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:42.974411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76281d-3711-44e5-a09f-ebfec1167f4c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:43.033756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b895d-0d76-4247-bbe3-5ba634259cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:43.034378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b895d-0d76-4247-bbe3-5ba634259cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:43.034657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b895d-0d76-4247-bbe3-5ba634259cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:43.034960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b895d-0d76-4247-bbe3-5ba634259cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:43.035658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b895d-0d76-4247-bbe3-5ba634259cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:43.037237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b895d-0d76-4247-bbe3-5ba634259cf9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:43.048304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1098/2194] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:43.052465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e43e2b-4f70-4015-a644-e34f3d3b842e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:43.063496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e43e2b-4f70-4015-a644-e34f3d3b842e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:43.068182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c278e8-a8d2-4440-ba3d-d91499a7c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:43.068854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c278e8-a8d2-4440-ba3d-d91499a7c87c admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:43.069950 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c278e8-a8d2-4440-ba3d-d91499a7c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:43.070275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c278e8-a8d2-4440-ba3d-d91499a7c87c admin admin] PATH_INFO: `/v3/projects/bc325b50f2a84949b5d97a80215eae8e/users/91de80583d3446799cd6256e3115fa16/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:43.072543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c278e8-a8d2-4440-ba3d-d91499a7c87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc325b50f2a84949b5d97a80215eae8e, user_id=91de80583d3446799cd6256e3115fa16, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:43.075270 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c278e8-a8d2-4440-ba3d-d91499a7c87c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:43.086934 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1097/2195] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:43 2022] PUT /identity/v3/projects/bc325b50f2a84949b5d97a80215eae8e/users/91de80583d3446799cd6256e3115fa16/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:43.437988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b895d-0d76-4247-bbe3-5ba634259cf9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:43.439890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7e1b895d-0d76-4247-bbe3-5ba634259cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:43.461107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b895d-0d76-4247-bbe3-5ba634259cf9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:43.530701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:43.531518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:43.531857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:43.532244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] PATH_INFO: `/v3/users/235a75d2f20a41f4be5e18ffe4b6eed4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:43.533846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235a75d2f20a41f4be5e18ffe4b6eed4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:43.536021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:43.565675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:43.601283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235a75d2f20a41f4be5e18ffe4b6eed4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:43.611401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235a75d2f20a41f4be5e18ffe4b6eed4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:43.628907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235a75d2f20a41f4be5e18ffe4b6eed4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:43.630848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235a75d2f20a41f4be5e18ffe4b6eed4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:43.639690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235a75d2f20a41f4be5e18ffe4b6eed4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:43.646662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1099/2196] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:52:43 2022] DELETE /identity/v3/users/235a75d2f20a41f4be5e18ffe4b6eed4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:43.651291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0e253-95ae-443e-98c7-c070d247d9da None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:43.651728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0e253-95ae-443e-98c7-c070d247d9da None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:43.651906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0e253-95ae-443e-98c7-c070d247d9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:43.667542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:43.689070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9cf0e253-95ae-443e-98c7-c070d247d9da None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:43.691215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9cf0e253-95ae-443e-98c7-c070d247d9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:43.794335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1098/2197] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:43.805804 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:43.811343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:43.898421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8cbbb-5721-4ac5-b867-eb450d556aa0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:43.903019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58268ad9-e827-4c4b-8cbd-457bccc311bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:43.903937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58268ad9-e827-4c4b-8cbd-457bccc311bc service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:43.904694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58268ad9-e827-4c4b-8cbd-457bccc311bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:43.905262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58268ad9-e827-4c4b-8cbd-457bccc311bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:43.928739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58268ad9-e827-4c4b-8cbd-457bccc311bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:43.930329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58268ad9-e827-4c4b-8cbd-457bccc311bc service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:43.963437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1100/2198] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:44.746031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0e253-95ae-443e-98c7-c070d247d9da None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:44.747819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9cf0e253-95ae-443e-98c7-c070d247d9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:44.795452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0e253-95ae-443e-98c7-c070d247d9da None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:44.801544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:44.804865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:44.805375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:44.805797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] PATH_INFO: `/v3/projects/1c71a9b128fd4979b27108fd5a13d43c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:44.807896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c71a9b128fd4979b27108fd5a13d43c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:44.810256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:44.942492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c71a9b128fd4979b27108fd5a13d43c', 'request_id': 'req-5e0932f1-e97f-4693-88e6-09e374d381e2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:44.984267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c71a9b128fd4979b27108fd5a13d43c', 'request_id': 'req-5e0932f1-e97f-4693-88e6-09e374d381e2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:44.998527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c71a9b128fd4979b27108fd5a13d43c', 'request_id': 'req-5e0932f1-e97f-4693-88e6-09e374d381e2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:45.018632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] The token cache is being invalidate because project 1c71a9b128fd4979b27108fd5a13d43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:52:45.019444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:45.021444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5e0932f1-e97f-4693-88e6-09e374d381e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:52:45.023947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1099/2199] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:52:44 2022] DELETE /identity/v3/projects/1c71a9b128fd4979b27108fd5a13d43c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:45.031694 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215558da-6a9a-4032-bf81-e22102099527 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:45.032591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215558da-6a9a-4032-bf81-e22102099527 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:45.033072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215558da-6a9a-4032-bf81-e22102099527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:45.106333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-215558da-6a9a-4032-bf81-e22102099527 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:45.108200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-215558da-6a9a-4032-bf81-e22102099527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:45.261423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1101/2200] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:52:45.267363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd7e3b-821c-47d6-9b82-03cde9af7477 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:45.268172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd7e3b-821c-47d6-9b82-03cde9af7477 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:45.269278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd7e3b-821c-47d6-9b82-03cde9af7477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:45.352690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c2fd7e3b-821c-47d6-9b82-03cde9af7477 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:45.372921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c2fd7e3b-821c-47d6-9b82-03cde9af7477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:45.401746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215558da-6a9a-4032-bf81-e22102099527 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:45.426778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1100/2201] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:45.454284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215558da-6a9a-4032-bf81-e22102099527 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:45.470211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b104272-e146-4cfd-a9eb-9c323bfc0024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:45.471339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b104272-e146-4cfd-a9eb-9c323bfc0024 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:45.471886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b104272-e146-4cfd-a9eb-9c323bfc0024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:45.472623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b104272-e146-4cfd-a9eb-9c323bfc0024 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:45.474739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b104272-e146-4cfd-a9eb-9c323bfc0024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:52:45.475733 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b104272-e146-4cfd-a9eb-9c323bfc0024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:45.486873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b104272-e146-4cfd-a9eb-9c323bfc0024 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:45.514716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd7e3b-821c-47d6-9b82-03cde9af7477 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:45.523293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1102/2202] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:52:45.528689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd7e3b-821c-47d6-9b82-03cde9af7477 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:45.547140 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa951fd9-6fb5-4d70-8bd0-5c7661c1e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:45.566586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa951fd9-6fb5-4d70-8bd0-5c7661c1e99f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:45.567036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa951fd9-6fb5-4d70-8bd0-5c7661c1e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:45.567274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa951fd9-6fb5-4d70-8bd0-5c7661c1e99f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:45.574389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa951fd9-6fb5-4d70-8bd0-5c7661c1e99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:45.588255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa951fd9-6fb5-4d70-8bd0-5c7661c1e99f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:45.672497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b104272-e146-4cfd-a9eb-9c323bfc0024 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:45.679219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1101/2203] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:52:45 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:52:45.692292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b104272-e146-4cfd-a9eb-9c323bfc0024 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:45.751056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:45.815981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb85a3-4ad1-465c-b13c-a3fd2d8b09c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:45.817161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb85a3-4ad1-465c-b13c-a3fd2d8b09c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:45.817559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb85a3-4ad1-465c-b13c-a3fd2d8b09c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:45.817947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb85a3-4ad1-465c-b13c-a3fd2d8b09c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:45.818745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb85a3-4ad1-465c-b13c-a3fd2d8b09c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:45.827906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb85a3-4ad1-465c-b13c-a3fd2d8b09c7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:45.875843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1103/2204] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:52:45 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:52:45.878977 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa951fd9-6fb5-4d70-8bd0-5c7661c1e99f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:45.906375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa951fd9-6fb5-4d70-8bd0-5c7661c1e99f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:45.914678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631af07-baf2-4e82-814c-7106d5f00c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:45.916150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631af07-baf2-4e82-814c-7106d5f00c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:45.916982 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631af07-baf2-4e82-814c-7106d5f00c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:45.917483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631af07-baf2-4e82-814c-7106d5f00c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:45.918617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631af07-baf2-4e82-814c-7106d5f00c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:45.920625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631af07-baf2-4e82-814c-7106d5f00c8e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:45.940195 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1102/2205] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:45.946066 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb85a3-4ad1-465c-b13c-a3fd2d8b09c7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:45.960654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb85a3-4ad1-465c-b13c-a3fd2d8b09c7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:45.966628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e20fe-bebd-4ff0-b1fb-0dfd7794aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:45.967446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e20fe-bebd-4ff0-b1fb-0dfd7794aa3c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:45.967955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e20fe-bebd-4ff0-b1fb-0dfd7794aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:45.968316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e20fe-bebd-4ff0-b1fb-0dfd7794aa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:45.969328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e20fe-bebd-4ff0-b1fb-0dfd7794aa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:45.971109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e20fe-bebd-4ff0-b1fb-0dfd7794aa3c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:45.992940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1104/2206] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:52:45.998583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631af07-baf2-4e82-814c-7106d5f00c8e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:46.016879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631af07-baf2-4e82-814c-7106d5f00c8e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:46.026837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6854e-e282-4373-9457-ead9ac2373f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:46.027566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6854e-e282-4373-9457-ead9ac2373f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:46.028849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6854e-e282-4373-9457-ead9ac2373f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:46.029699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6854e-e282-4373-9457-ead9ac2373f8 admin admin] PATH_INFO: `/v3/projects/c2f907cffd2047aea54235f1c750f234/users/91dd24f48d5843fb973b5a2ce726227f/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:46.053416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6854e-e282-4373-9457-ead9ac2373f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f907cffd2047aea54235f1c750f234, user_id=91dd24f48d5843fb973b5a2ce726227f, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:46.057787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6854e-e282-4373-9457-ead9ac2373f8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:46.078572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1103/2207] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:52:45 2022] PUT /identity/v3/projects/c2f907cffd2047aea54235f1c750f234/users/91dd24f48d5843fb973b5a2ce726227f/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:52:46.086406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75daa7f-cfb2-4d8a-a013-21b58584f569 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:46.086980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75daa7f-cfb2-4d8a-a013-21b58584f569 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:46.087097 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75daa7f-cfb2-4d8a-a013-21b58584f569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:46.122250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e75daa7f-cfb2-4d8a-a013-21b58584f569 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:46.123625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e75daa7f-cfb2-4d8a-a013-21b58584f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:46.270285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1105/2208] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:52:46.287887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6854e-e282-4373-9457-ead9ac2373f8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:46.290248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cdb6854e-e282-4373-9457-ead9ac2373f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:46.339539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:46.419085 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6854e-e282-4373-9457-ead9ac2373f8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:46.441345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05a86-2b43-4e41-aeb4-cd9e04a12065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:46.442254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05a86-2b43-4e41-aeb4-cd9e04a12065 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:46.442873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05a86-2b43-4e41-aeb4-cd9e04a12065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:46.443779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05a86-2b43-4e41-aeb4-cd9e04a12065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:46.458300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae05a86-2b43-4e41-aeb4-cd9e04a12065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:46.460277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae05a86-2b43-4e41-aeb4-cd9e04a12065 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:46.483706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1104/2209] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:47.929020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc37cc1-843e-4fe2-98f7-3cb56da5e386 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:47.933202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc37cc1-843e-4fe2-98f7-3cb56da5e386 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:47.933708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc37cc1-843e-4fe2-98f7-3cb56da5e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:47.963591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6fc37cc1-843e-4fe2-98f7-3cb56da5e386 None None] MFA Rules not processed for user `91dd24f48d5843fb973b5a2ce726227f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:47.965284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6fc37cc1-843e-4fe2-98f7-3cb56da5e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:48.036955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1106/2210] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:48.050559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05a86-2b43-4e41-aeb4-cd9e04a12065 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:48.052306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0ae05a86-2b43-4e41-aeb4-cd9e04a12065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:48.130062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05a86-2b43-4e41-aeb4-cd9e04a12065 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:48.133685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2fc38-bf94-4390-b984-70ed6d17e066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:48.134312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2fc38-bf94-4390-b984-70ed6d17e066 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:48.134597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2fc38-bf94-4390-b984-70ed6d17e066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:48.134867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2fc38-bf94-4390-b984-70ed6d17e066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:48.144244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2fc38-bf94-4390-b984-70ed6d17e066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:48.145701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2fc38-bf94-4390-b984-70ed6d17e066 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:48.156768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1105/2211] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:49.638141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2aebe-4e1a-4f7b-92d3-f99a912d333e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:49.638683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2aebe-4e1a-4f7b-92d3-f99a912d333e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:49.638683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2aebe-4e1a-4f7b-92d3-f99a912d333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:49.668415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3aa2aebe-4e1a-4f7b-92d3-f99a912d333e None None] MFA Rules not processed for user `91dd24f48d5843fb973b5a2ce726227f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:49.669671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3aa2aebe-4e1a-4f7b-92d3-f99a912d333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:49.683755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1107/2212] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:50.147382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0935a-bae0-4006-822b-eb58f9487552 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:50.147842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0935a-bae0-4006-822b-eb58f9487552 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:50.147842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0935a-bae0-4006-822b-eb58f9487552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:50.177724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-98a0935a-bae0-4006-822b-eb58f9487552 None None] MFA Rules not processed for user `cb1cee30bc59446d882880d978b78bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:50.180052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-98a0935a-bae0-4006-822b-eb58f9487552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:50.273112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1106/2213] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:50.296615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbec90-06ce-4b66-af6c-9ba967033092 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:50.296900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbec90-06ce-4b66-af6c-9ba967033092 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:50.297169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbec90-06ce-4b66-af6c-9ba967033092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:50.344022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-86bbec90-06ce-4b66-af6c-9ba967033092 None None] MFA Rules not processed for user `91de80583d3446799cd6256e3115fa16`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:52:50.345668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-86bbec90-06ce-4b66-af6c-9ba967033092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:50.371404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:50.481340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1108/2214] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:52:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:52:50.495697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0935a-bae0-4006-822b-eb58f9487552 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:50.497109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-98a0935a-bae0-4006-822b-eb58f9487552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:50.599171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0935a-bae0-4006-822b-eb58f9487552 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:50.604856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792569-ece1-407e-8908-8cb2f0a6b417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:50.605643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792569-ece1-407e-8908-8cb2f0a6b417 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:50.606202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792569-ece1-407e-8908-8cb2f0a6b417 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:50.606490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792569-ece1-407e-8908-8cb2f0a6b417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:50.608464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0c792569-ece1-407e-8908-8cb2f0a6b417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:50.620844 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:50.692560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792569-ece1-407e-8908-8cb2f0a6b417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:50.694169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792569-ece1-407e-8908-8cb2f0a6b417 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:50.711601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1107/2215] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:52:52.628124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbec90-06ce-4b66-af6c-9ba967033092 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:52:52.645245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbec90-06ce-4b66-af6c-9ba967033092 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:52:52.649568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8114056-ac93-45a9-b49c-323356309deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:52:52.651186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114056-ac93-45a9-b49c-323356309deb service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:52:52.651657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114056-ac93-45a9-b49c-323356309deb service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:52:52.652130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114056-ac93-45a9-b49c-323356309deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:52:52.654808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d8114056-ac93-45a9-b49c-323356309deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:52:52.774206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8114056-ac93-45a9-b49c-323356309deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:52:52.776022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8114056-ac93-45a9-b49c-323356309deb service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:52:52.788459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1109/2216] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:52:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:53:00.701345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=22 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:02.783446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=49 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:14.293825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e07605-d968-4b24-a563-76f737b424bb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:53:14.294311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e07605-d968-4b24-a563-76f737b424bb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:53:14.294431 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e07605-d968-4b24-a563-76f737b424bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:53:14.313089 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c8e07605-d968-4b24-a563-76f737b424bb None None] MFA Rules not processed for user `91dd24f48d5843fb973b5a2ce726227f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:53:14.314307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c8e07605-d968-4b24-a563-76f737b424bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:53:14.321208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1108/2217] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:53:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:53:18.991254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54971-5144-421c-b5ca-0fe3033e3b5c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:53:18.991785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54971-5144-421c-b5ca-0fe3033e3b5c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:53:18.991785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54971-5144-421c-b5ca-0fe3033e3b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:53:19.011617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-16b54971-5144-421c-b5ca-0fe3033e3b5c None None] MFA Rules not processed for user `5efb3ea424f8450c883d4757545af18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:53:19.012771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-16b54971-5144-421c-b5ca-0fe3033e3b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:53:19.019997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1110/2218] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:53:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:53:24.307698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:29.005575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:45.305282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556949-6bf0-4b18-b971-9f68a2b56fdf None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:53:45.306453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556949-6bf0-4b18-b971-9f68a2b56fdf None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:53:45.306453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556949-6bf0-4b18-b971-9f68a2b56fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:53:45.325859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1c556949-6bf0-4b18-b971-9f68a2b56fdf None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:53:45.327093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1c556949-6bf0-4b18-b971-9f68a2b56fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:53:45.382025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1109/2219] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:53:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:53:45.421828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54971-5144-421c-b5ca-0fe3033e3b5c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:53:45.423389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-16b54971-5144-421c-b5ca-0fe3033e3b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:53:45.499132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54971-5144-421c-b5ca-0fe3033e3b5c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:53:45.504057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39ac5e-600b-47ca-b186-398ce798af08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:53:45.504940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39ac5e-600b-47ca-b186-398ce798af08 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:53:45.505254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39ac5e-600b-47ca-b186-398ce798af08 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:53:45.505528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39ac5e-600b-47ca-b186-398ce798af08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:53:45.513779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39ac5e-600b-47ca-b186-398ce798af08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:53:45.515644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39ac5e-600b-47ca-b186-398ce798af08 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:53:45.523939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1111/2220] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:53:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:53:46.314311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556949-6bf0-4b18-b971-9f68a2b56fdf None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:53:46.326458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556949-6bf0-4b18-b971-9f68a2b56fdf None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:53:46.332411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f12041-71af-4b42-9ffe-7f313d6d3460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:53:46.332582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f12041-71af-4b42-9ffe-7f313d6d3460 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:53:46.332984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f12041-71af-4b42-9ffe-7f313d6d3460 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:53:46.333719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f12041-71af-4b42-9ffe-7f313d6d3460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:53:46.350753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f12041-71af-4b42-9ffe-7f313d6d3460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:53:46.353248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f12041-71af-4b42-9ffe-7f313d6d3460 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:53:46.381664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1110/2221] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:53:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:53:50.119828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3bc9e-9b8e-45a1-97bf-a7110d89b8df None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:53:50.120506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3bc9e-9b8e-45a1-97bf-a7110d89b8df None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:53:50.120506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3bc9e-9b8e-45a1-97bf-a7110d89b8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:53:50.174232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2bf3bc9e-9b8e-45a1-97bf-a7110d89b8df None None] MFA Rules not processed for user `df8fb928aa42413b9d03e83f46dd48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:53:50.175500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2bf3bc9e-9b8e-45a1-97bf-a7110d89b8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:53:50.265874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1112/2222] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:53:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:53:56.362987 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=31 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:00.256754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=57 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:02.614102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c301-cb0b-4868-a346-311650596aee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:02.614632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c301-cb0b-4868-a346-311650596aee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:02.614632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c301-cb0b-4868-a346-311650596aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:02.634409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8bf1c301-cb0b-4868-a346-311650596aee None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:02.635640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8bf1c301-cb0b-4868-a346-311650596aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:02.643086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1111/2223] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 27 07:54:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:02.655184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3bc9e-9b8e-45a1-97bf-a7110d89b8df None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:02.666807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3bc9e-9b8e-45a1-97bf-a7110d89b8df None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:02.671765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292b59d-b6f6-4349-8c73-7f719b55409f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:02.672367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292b59d-b6f6-4349-8c73-7f719b55409f service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:02.672642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292b59d-b6f6-4349-8c73-7f719b55409f service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:02.672965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292b59d-b6f6-4349-8c73-7f719b55409f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:02.681409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292b59d-b6f6-4349-8c73-7f719b55409f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:02.683022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292b59d-b6f6-4349-8c73-7f719b55409f service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:02.690837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1113/2224] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:54:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:54:04.702336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1c301-cb0b-4868-a346-311650596aee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:04.715894 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1c301-cb0b-4868-a346-311650596aee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:04.720526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:04.721170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:04.721447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:04.721747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] PATH_INFO: `/v3/users/91dd24f48d5843fb973b5a2ce726227f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:04.722965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=91dd24f48d5843fb973b5a2ce726227f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:04.725639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:04.775875 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91dd24f48d5843fb973b5a2ce726227f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:04.787586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91dd24f48d5843fb973b5a2ce726227f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:04.788261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91dd24f48d5843fb973b5a2ce726227f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:04.795551 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91dd24f48d5843fb973b5a2ce726227f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:04.796192 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ba5ba8ed-b161-4920-bde5-b473737b0b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91dd24f48d5843fb973b5a2ce726227f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:04.808808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1112/2225] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:54:04 2022] DELETE /identity/v3/users/91dd24f48d5843fb973b5a2ce726227f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:54:04.980318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292b59d-b6f6-4349-8c73-7f719b55409f service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:04.991931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292b59d-b6f6-4349-8c73-7f719b55409f service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:05.054150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:05.055372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.055668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.055939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] PATH_INFO: `/v3/projects/c2f907cffd2047aea54235f1c750f234` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.057126 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f907cffd2047aea54235f1c750f234)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:05.059093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:05.114544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f907cffd2047aea54235f1c750f234', 'request_id': 'req-88a605e1-90f6-401c-a469-486813ccd9c8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:05.124026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f907cffd2047aea54235f1c750f234', 'request_id': 'req-88a605e1-90f6-401c-a469-486813ccd9c8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:05.130572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f907cffd2047aea54235f1c750f234', 'request_id': 'req-88a605e1-90f6-401c-a469-486813ccd9c8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:05.141853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] The token cache is being invalidate because project c2f907cffd2047aea54235f1c750f234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:54:05.142136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:05.142788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a605e1-90f6-401c-a469-486813ccd9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:54:05.144324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1114/2226] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:54:04 2022] DELETE /identity/v3/projects/c2f907cffd2047aea54235f1c750f234 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:54:05.149299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39d2e8-ec58-4758-942a-a1ec621637ca None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.149581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39d2e8-ec58-4758-942a-a1ec621637ca None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.149848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39d2e8-ec58-4758-942a-a1ec621637ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.170346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-da39d2e8-ec58-4758-942a-a1ec621637ca None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:05.171684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-da39d2e8-ec58-4758-942a-a1ec621637ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:05.235737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1113/2227] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:05.244007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664583f-f1b9-4e70-8ea7-6236f429297f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.244293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664583f-f1b9-4e70-8ea7-6236f429297f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.244569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664583f-f1b9-4e70-8ea7-6236f429297f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.265678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9664583f-f1b9-4e70-8ea7-6236f429297f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:05.266964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9664583f-f1b9-4e70-8ea7-6236f429297f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:05.275510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1115/2228] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:05.279761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39d2e8-ec58-4758-942a-a1ec621637ca None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:05.290183 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39d2e8-ec58-4758-942a-a1ec621637ca None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:05.294808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab73e5-9c2d-42d7-a40a-027701d6db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:05.295454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab73e5-9c2d-42d7-a40a-027701d6db18 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.295733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab73e5-9c2d-42d7-a40a-027701d6db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.296002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab73e5-9c2d-42d7-a40a-027701d6db18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.296703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab73e5-9c2d-42d7-a40a-027701d6db18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:54:05.297004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab73e5-9c2d-42d7-a40a-027701d6db18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:05.298609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab73e5-9c2d-42d7-a40a-027701d6db18 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:05.310138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1114/2229] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:54:05.314395 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664583f-f1b9-4e70-8ea7-6236f429297f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:05.324381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664583f-f1b9-4e70-8ea7-6236f429297f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:05.329329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18cbce-5a41-4b71-9929-c4e4fe015ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:05.329939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18cbce-5a41-4b71-9929-c4e4fe015ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.330222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18cbce-5a41-4b71-9929-c4e4fe015ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.330498 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18cbce-5a41-4b71-9929-c4e4fe015ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.331213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18cbce-5a41-4b71-9929-c4e4fe015ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:05.333246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18cbce-5a41-4b71-9929-c4e4fe015ab3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:05.362005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1116/2230] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:54:05 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:54:05.366400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab73e5-9c2d-42d7-a40a-027701d6db18 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:05.376889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab73e5-9c2d-42d7-a40a-027701d6db18 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:05.427639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:05.438518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc10c-33ce-4607-821b-e9a5f74f9a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:05.439171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc10c-33ce-4607-821b-e9a5f74f9a97 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.439450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc10c-33ce-4607-821b-e9a5f74f9a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.439718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc10c-33ce-4607-821b-e9a5f74f9a97 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.440398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddc10c-33ce-4607-821b-e9a5f74f9a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:05.442287 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddc10c-33ce-4607-821b-e9a5f74f9a97 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:05.473075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1115/2231] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:54:05 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:54:05.477418 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18cbce-5a41-4b71-9929-c4e4fe015ab3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:05.487763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18cbce-5a41-4b71-9929-c4e4fe015ab3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:05.493003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec2ddd-d247-4bca-a41e-0c468dc2e5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:05.493609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2ddd-d247-4bca-a41e-0c468dc2e5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.493905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2ddd-d247-4bca-a41e-0c468dc2e5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.494184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2ddd-d247-4bca-a41e-0c468dc2e5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.494891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec2ddd-d247-4bca-a41e-0c468dc2e5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:05.496487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec2ddd-d247-4bca-a41e-0c468dc2e5c0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:05.506828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1117/2232] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:54:05.511605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc10c-33ce-4607-821b-e9a5f74f9a97 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:05.522211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc10c-33ce-4607-821b-e9a5f74f9a97 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:05.527701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d04de-eb58-4fcd-b45b-a6a7ff1f7305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:05.528342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d04de-eb58-4fcd-b45b-a6a7ff1f7305 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.528624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d04de-eb58-4fcd-b45b-a6a7ff1f7305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.528897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d04de-eb58-4fcd-b45b-a6a7ff1f7305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.529633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d04de-eb58-4fcd-b45b-a6a7ff1f7305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:05.531350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d04de-eb58-4fcd-b45b-a6a7ff1f7305 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:05.542911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1116/2233] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:54:05.547165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec2ddd-d247-4bca-a41e-0c468dc2e5c0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:05.558183 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec2ddd-d247-4bca-a41e-0c468dc2e5c0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:05.563227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46250fa6-bb47-42cf-a860-1781ddceccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:05.563991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46250fa6-bb47-42cf-a860-1781ddceccb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.564344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46250fa6-bb47-42cf-a860-1781ddceccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.564692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46250fa6-bb47-42cf-a860-1781ddceccb9 admin admin] PATH_INFO: `/v3/projects/d312b027f97e482d82eea4bdd7bb3166/users/d93f5d182474439bb6ea1d8b70f39b2b/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.582255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46250fa6-bb47-42cf-a860-1781ddceccb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d312b027f97e482d82eea4bdd7bb3166, user_id=d93f5d182474439bb6ea1d8b70f39b2b, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:05.585194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46250fa6-bb47-42cf-a860-1781ddceccb9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:05.602921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1118/2234] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:54:05 2022] PUT /identity/v3/projects/d312b027f97e482d82eea4bdd7bb3166/users/d93f5d182474439bb6ea1d8b70f39b2b/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:54:05.608024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d283-29df-48ca-9c5b-fbdf6dfe9c9c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.608497 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d283-29df-48ca-9c5b-fbdf6dfe9c9c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.608833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d283-29df-48ca-9c5b-fbdf6dfe9c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.630940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f9a2d283-29df-48ca-9c5b-fbdf6dfe9c9c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:05.630940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f9a2d283-29df-48ca-9c5b-fbdf6dfe9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:05.692867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1117/2235] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:05.702606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46250fa6-bb47-42cf-a860-1781ddceccb9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:05.704591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-46250fa6-bb47-42cf-a860-1781ddceccb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:05.721121 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:05.781325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46250fa6-bb47-42cf-a860-1781ddceccb9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:05.785042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996eb5-e351-4638-b13c-d41a4a37b40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:05.785671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996eb5-e351-4638-b13c-d41a4a37b40c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:05.785955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996eb5-e351-4638-b13c-d41a4a37b40c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:05.786233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996eb5-e351-4638-b13c-d41a4a37b40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:05.796250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f996eb5-e351-4638-b13c-d41a4a37b40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:05.797858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f996eb5-e351-4638-b13c-d41a4a37b40c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:05.808250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1119/2236] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:11.347764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c487ece-29db-45ca-bc3f-f58c19d1babb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:11.348512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c487ece-29db-45ca-bc3f-f58c19d1babb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:11.348622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c487ece-29db-45ca-bc3f-f58c19d1babb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:11.383778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7c487ece-29db-45ca-bc3f-f58c19d1babb None None] MFA Rules not processed for user `d93f5d182474439bb6ea1d8b70f39b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:11.385160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7c487ece-29db-45ca-bc3f-f58c19d1babb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:11.483510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1118/2237] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:54:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:54:11.488118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996eb5-e351-4638-b13c-d41a4a37b40c service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:11.500074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996eb5-e351-4638-b13c-d41a4a37b40c service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:11.505400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cb835-1c51-4941-bc19-2ce11a7a67d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:11.506254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cb835-1c51-4941-bc19-2ce11a7a67d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:11.506532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cb835-1c51-4941-bc19-2ce11a7a67d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:11.506806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cb835-1c51-4941-bc19-2ce11a7a67d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:11.507555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cb835-1c51-4941-bc19-2ce11a7a67d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:11.509511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cb835-1c51-4941-bc19-2ce11a7a67d5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:11.545815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1120/2238] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:54:11 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:54:11.549779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c487ece-29db-45ca-bc3f-f58c19d1babb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:11.561567 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c487ece-29db-45ca-bc3f-f58c19d1babb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:11.639045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894805-bdaa-48bd-991c-de28f592969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:11.639680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894805-bdaa-48bd-991c-de28f592969d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:11.639983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894805-bdaa-48bd-991c-de28f592969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:11.640274 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894805-bdaa-48bd-991c-de28f592969d admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:11.641066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54894805-bdaa-48bd-991c-de28f592969d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:11.643306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54894805-bdaa-48bd-991c-de28f592969d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:11.654536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:11.670239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1119/2239] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:54:11 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:54:11.674189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cb835-1c51-4941-bc19-2ce11a7a67d5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:11.685792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cb835-1c51-4941-bc19-2ce11a7a67d5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:11.691101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c815-6345-4642-808e-1248853f308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:11.691806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c815-6345-4642-808e-1248853f308b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:11.692154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c815-6345-4642-808e-1248853f308b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:11.692502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c815-6345-4642-808e-1248853f308b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:11.693288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9c815-6345-4642-808e-1248853f308b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:11.695875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9c815-6345-4642-808e-1248853f308b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:11.708618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1121/2240] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:54:11.712880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894805-bdaa-48bd-991c-de28f592969d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:11.723884 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894805-bdaa-48bd-991c-de28f592969d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:11.729472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a794d-30df-4e6d-b04d-0649fdb5f9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:11.730157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a794d-30df-4e6d-b04d-0649fdb5f9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:11.730440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a794d-30df-4e6d-b04d-0649fdb5f9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:11.730717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a794d-30df-4e6d-b04d-0649fdb5f9c4 admin admin] PATH_INFO: `/v3/projects/c244c27591974a429fd176a8f520c1ed/users/02048810ba0b466d9565b93c04e26faf/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:11.747226 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a794d-30df-4e6d-b04d-0649fdb5f9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c244c27591974a429fd176a8f520c1ed, user_id=02048810ba0b466d9565b93c04e26faf, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:11.749862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a794d-30df-4e6d-b04d-0649fdb5f9c4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:11.769496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1120/2241] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:54:11 2022] PUT /identity/v3/projects/c244c27591974a429fd176a8f520c1ed/users/02048810ba0b466d9565b93c04e26faf/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:54:11.773527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c815-6345-4642-808e-1248853f308b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:11.783996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c815-6345-4642-808e-1248853f308b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:11.846166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae2a4b-db0e-4a9a-98ec-0aa0a44693d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:11.846818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2a4b-db0e-4a9a-98ec-0aa0a44693d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:11.847140 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2a4b-db0e-4a9a-98ec-0aa0a44693d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:11.847414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2a4b-db0e-4a9a-98ec-0aa0a44693d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:11.848401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae2a4b-db0e-4a9a-98ec-0aa0a44693d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:11.852364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae2a4b-db0e-4a9a-98ec-0aa0a44693d2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:11.864275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1122/2242] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:54:11.869201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a794d-30df-4e6d-b04d-0649fdb5f9c4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:11.881271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a794d-30df-4e6d-b04d-0649fdb5f9c4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:11.887710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32c835-2879-4f06-8bcd-0548ef8bdc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:11.888415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32c835-2879-4f06-8bcd-0548ef8bdc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:11.888698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32c835-2879-4f06-8bcd-0548ef8bdc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:11.888975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32c835-2879-4f06-8bcd-0548ef8bdc1e admin admin] PATH_INFO: `/v3/projects/c244c27591974a429fd176a8f520c1ed/users/02048810ba0b466d9565b93c04e26faf/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:11.891448 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32c835-2879-4f06-8bcd-0548ef8bdc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c244c27591974a429fd176a8f520c1ed, user_id=02048810ba0b466d9565b93c04e26faf, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:11.893773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32c835-2879-4f06-8bcd-0548ef8bdc1e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:11.905221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1121/2243] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:54:11 2022] PUT /identity/v3/projects/c244c27591974a429fd176a8f520c1ed/users/02048810ba0b466d9565b93c04e26faf/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:54:15.485203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4f983-0e46-4053-9a90-9d9a79ae3ac7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:15.485764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4f983-0e46-4053-9a90-9d9a79ae3ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:15.486029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4f983-0e46-4053-9a90-9d9a79ae3ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:15.524628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-43e4f983-0e46-4053-9a90-9d9a79ae3ac7 None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:15.531628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-43e4f983-0e46-4053-9a90-9d9a79ae3ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:15.690652 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1123/2244] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:54:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:15.709280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32c835-2879-4f06-8bcd-0548ef8bdc1e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:15.711702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1d32c835-2879-4f06-8bcd-0548ef8bdc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:15.800977 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32c835-2879-4f06-8bcd-0548ef8bdc1e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:15.808299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e78db-0e2a-49a3-b218-7cbdbc94a1ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:15.809193 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e78db-0e2a-49a3-b218-7cbdbc94a1ff service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:15.809717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e78db-0e2a-49a3-b218-7cbdbc94a1ff service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:15.810088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e78db-0e2a-49a3-b218-7cbdbc94a1ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:15.821248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e78db-0e2a-49a3-b218-7cbdbc94a1ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:15.823176 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e78db-0e2a-49a3-b218-7cbdbc94a1ff service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:15.833513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1122/2245] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:54:17.901223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a34ad5-6b29-41d7-a99c-8f148ee35801 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:17.901765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a34ad5-6b29-41d7-a99c-8f148ee35801 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:17.902964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a34ad5-6b29-41d7-a99c-8f148ee35801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:17.975255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-11a34ad5-6b29-41d7-a99c-8f148ee35801 None None] MFA Rules not processed for user `02048810ba0b466d9565b93c04e26faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:17.976894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-11a34ad5-6b29-41d7-a99c-8f148ee35801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:18.011098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:18.093514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1124/2246] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:54:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:18.107547 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e78db-0e2a-49a3-b218-7cbdbc94a1ff service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:18.117137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c32e78db-0e2a-49a3-b218-7cbdbc94a1ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:18.221721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e78db-0e2a-49a3-b218-7cbdbc94a1ff service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:18.228570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc84574-2e3c-4eb6-97dd-53d492bd8a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:18.229346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc84574-2e3c-4eb6-97dd-53d492bd8a44 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:18.229697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc84574-2e3c-4eb6-97dd-53d492bd8a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:18.230061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc84574-2e3c-4eb6-97dd-53d492bd8a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:18.307357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:18.329855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc84574-2e3c-4eb6-97dd-53d492bd8a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:18.332115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc84574-2e3c-4eb6-97dd-53d492bd8a44 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:18.345962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1123/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:20.235844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11c8f5-9823-4999-ab90-fbe0fbd31d3f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:20.236889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11c8f5-9823-4999-ab90-fbe0fbd31d3f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:20.237313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11c8f5-9823-4999-ab90-fbe0fbd31d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:20.286851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1c11c8f5-9823-4999-ab90-fbe0fbd31d3f None None] MFA Rules not processed for user `d93f5d182474439bb6ea1d8b70f39b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:20.288339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1c11c8f5-9823-4999-ab90-fbe0fbd31d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:20.304815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1125/2248] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:54:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:27.811903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc84574-2e3c-4eb6-97dd-53d492bd8a44 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:27.865828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc84574-2e3c-4eb6-97dd-53d492bd8a44 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:27.869479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc302e8-3063-4d44-bf07-3dee78c66f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:27.870094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc302e8-3063-4d44-bf07-3dee78c66f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:27.870373 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc302e8-3063-4d44-bf07-3dee78c66f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:27.870644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc302e8-3063-4d44-bf07-3dee78c66f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:27.872428 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7cc302e8-3063-4d44-bf07-3dee78c66f4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:27.886601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc302e8-3063-4d44-bf07-3dee78c66f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:27.888132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc302e8-3063-4d44-bf07-3dee78c66f4a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:27.900151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1124/2249] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:30.252727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=26 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:31.532190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11c8f5-9823-4999-ab90-fbe0fbd31d3f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:31.533759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1c11c8f5-9823-4999-ab90-fbe0fbd31d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:31.546320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11c8f5-9823-4999-ab90-fbe0fbd31d3f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:31.550680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea725ee-84f5-4815-a779-bfc5a7837491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:31.551783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea725ee-84f5-4815-a779-bfc5a7837491 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:31.552059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea725ee-84f5-4815-a779-bfc5a7837491 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:31.552328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea725ee-84f5-4815-a779-bfc5a7837491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:31.554137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cea725ee-84f5-4815-a779-bfc5a7837491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:31.568298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea725ee-84f5-4815-a779-bfc5a7837491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:31.570231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea725ee-84f5-4815-a779-bfc5a7837491 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:31.584128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1126/2250] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:33.478057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c7543-b280-4674-8332-547a36644f9b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:33.478669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c7543-b280-4674-8332-547a36644f9b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:33.478669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c7543-b280-4674-8332-547a36644f9b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:33.479986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1125/2251] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:54:33.487210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf247b54-adf5-43de-be52-d175406473e3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:33.487775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf247b54-adf5-43de-be52-d175406473e3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:33.487972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf247b54-adf5-43de-be52-d175406473e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:33.513681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cf247b54-adf5-43de-be52-d175406473e3 None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:33.514947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cf247b54-adf5-43de-be52-d175406473e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:33.524452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1127/2252] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:54:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:33.536017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c7543-b280-4674-8332-547a36644f9b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:33.537747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2c8c7543-b280-4674-8332-547a36644f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:33.612350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c7543-b280-4674-8332-547a36644f9b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:33.616855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5b042-7acc-4df3-8fc8-d19598940ab7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7a3c5f6b9645fb8cd2a65cee4f37c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:33.617487 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b042-7acc-4df3-8fc8-d19598940ab7 service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:33.617770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b042-7acc-4df3-8fc8-d19598940ab7 service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:33.618042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b042-7acc-4df3-8fc8-d19598940ab7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:33.629842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5b042-7acc-4df3-8fc8-d19598940ab7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:33.631420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5b042-7acc-4df3-8fc8-d19598940ab7 service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:33.642277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1126/2253] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:33.711501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5310-d208-448f-8c03-920b7cdaa36a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:33.711779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5310-d208-448f-8c03-920b7cdaa36a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:33.712056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5310-d208-448f-8c03-920b7cdaa36a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:33.713425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1128/2254] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:54:33.718266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab16f60-7167-44e2-a7b1-5cdd10f041bd None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:33.718570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab16f60-7167-44e2-a7b1-5cdd10f041bd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:33.718859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab16f60-7167-44e2-a7b1-5cdd10f041bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:33.741680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fab16f60-7167-44e2-a7b1-5cdd10f041bd None None] MFA Rules not processed for user `0c65277d89a24081a47a7f928f6c6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:33.743036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fab16f60-7167-44e2-a7b1-5cdd10f041bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:33.749606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1127/2255] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:54:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:33.761611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb5310-d208-448f-8c03-920b7cdaa36a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:33.772920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb5310-d208-448f-8c03-920b7cdaa36a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:33.776507 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526e7be-eb4c-4196-8009-12b696f27376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:33.777124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526e7be-eb4c-4196-8009-12b696f27376 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:33.777464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526e7be-eb4c-4196-8009-12b696f27376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:33.777739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526e7be-eb4c-4196-8009-12b696f27376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:33.785772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526e7be-eb4c-4196-8009-12b696f27376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:33.787257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526e7be-eb4c-4196-8009-12b696f27376 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:33.796378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1129/2256] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:33.882909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84452283-1481-487a-a0aa-56a8ffaaf29c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:33.883231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84452283-1481-487a-a0aa-56a8ffaaf29c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:33.883534 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84452283-1481-487a-a0aa-56a8ffaaf29c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:33.884877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1128/2257] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 27 07:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 07:54:33.892770 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a61e09-5aca-4109-9e1c-d546b0f1d787 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:33.893182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a61e09-5aca-4109-9e1c-d546b0f1d787 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:33.893556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a61e09-5aca-4109-9e1c-d546b0f1d787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:33.914141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-44a61e09-5aca-4109-9e1c-d546b0f1d787 None None] MFA Rules not processed for user `0445b52b85994510ad9e66de366ebf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:33.915389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-44a61e09-5aca-4109-9e1c-d546b0f1d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:33.924858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1130/2258] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 27 07:54:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:33.935577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84452283-1481-487a-a0aa-56a8ffaaf29c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:33.946997 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84452283-1481-487a-a0aa-56a8ffaaf29c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:33.951116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440bd35-c83c-4cac-9438-692f8e45da8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:33.951741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440bd35-c83c-4cac-9438-692f8e45da8c service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:33.952022 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440bd35-c83c-4cac-9438-692f8e45da8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:33.952297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440bd35-c83c-4cac-9438-692f8e45da8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:33.964302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440bd35-c83c-4cac-9438-692f8e45da8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:33.965738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440bd35-c83c-4cac-9438-692f8e45da8c service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:33.977874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1129/2259] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:36.971704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b32a97-6329-4f68-aee8-26dd7033b6aa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:36.972171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b32a97-6329-4f68-aee8-26dd7033b6aa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:36.972290 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b32a97-6329-4f68-aee8-26dd7033b6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:36.992460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-28b32a97-6329-4f68-aee8-26dd7033b6aa None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:54:36.993659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-28b32a97-6329-4f68-aee8-26dd7033b6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:37.000996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1131/2260] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:54:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:54:37.013715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440bd35-c83c-4cac-9438-692f8e45da8c service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:37.024881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440bd35-c83c-4cac-9438-692f8e45da8c service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:37.030177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba833ada-dccf-475d-907c-2aa77441f03a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:37.030773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba833ada-dccf-475d-907c-2aa77441f03a service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:37.031082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba833ada-dccf-475d-907c-2aa77441f03a service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:37.031351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba833ada-dccf-475d-907c-2aa77441f03a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:37.039792 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba833ada-dccf-475d-907c-2aa77441f03a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:37.041368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba833ada-dccf-475d-907c-2aa77441f03a service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:37.049641 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1130/2261] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:54:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:54:46.986298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=21 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:47.046280 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=76 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:48.763154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b32a97-6329-4f68-aee8-26dd7033b6aa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:48.774279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b32a97-6329-4f68-aee8-26dd7033b6aa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:48.777922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:48.778548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:48.778825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:48.779135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:48.780941 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:48.790777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:48.792253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:48.800226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1132/2262] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:49.290445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba833ada-dccf-475d-907c-2aa77441f03a service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:49.292177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ba833ada-dccf-475d-907c-2aa77441f03a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:49.374377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba833ada-dccf-475d-907c-2aa77441f03a service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:49.379531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f71cd-d15b-4da7-9ef4-277777c55796 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:49.380152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f71cd-d15b-4da7-9ef4-277777c55796 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:49.380433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f71cd-d15b-4da7-9ef4-277777c55796 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:49.380703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f71cd-d15b-4da7-9ef4-277777c55796 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:49.382506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b35f71cd-d15b-4da7-9ef4-277777c55796 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:49.394299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f71cd-d15b-4da7-9ef4-277777c55796 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:49.395907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f71cd-d15b-4da7-9ef4-277777c55796 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:49.407591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1131/2263] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:50.267629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:50.268989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:50.285842 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85229843-7764-4dd3-9a75-8f28e61ca9ea service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:50.292220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c60a58-bc4b-4cba-b56e-9ba8ce757dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:50.292832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c60a58-bc4b-4cba-b56e-9ba8ce757dc2 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:50.293115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c60a58-bc4b-4cba-b56e-9ba8ce757dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:50.293394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c60a58-bc4b-4cba-b56e-9ba8ce757dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:50.295184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b2c60a58-bc4b-4cba-b56e-9ba8ce757dc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:50.361441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c60a58-bc4b-4cba-b56e-9ba8ce757dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:50.363108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c60a58-bc4b-4cba-b56e-9ba8ce757dc2 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:50.374761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1133/2264] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:54:55.850207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f71cd-d15b-4da7-9ef4-277777c55796 service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:54:55.859940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f71cd-d15b-4da7-9ef4-277777c55796 service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:54:55.863515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86d4cb-a18d-40fc-ae7c-f062c816b9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:54:55.864252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86d4cb-a18d-40fc-ae7c-f062c816b9fd service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:54:55.864538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86d4cb-a18d-40fc-ae7c-f062c816b9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:54:55.864812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86d4cb-a18d-40fc-ae7c-f062c816b9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:54:55.867259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0b86d4cb-a18d-40fc-ae7c-f062c816b9fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:54:55.876998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86d4cb-a18d-40fc-ae7c-f062c816b9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:54:55.878515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86d4cb-a18d-40fc-ae7c-f062c816b9fd service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:54:55.888243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1132/2265] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:54:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:55:00.369220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=34 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:05.883952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=38 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:10.986246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceb5d7-ab21-4635-af29-406a12145d42 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:55:10.986757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceb5d7-ab21-4635-af29-406a12145d42 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:55:10.986849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceb5d7-ab21-4635-af29-406a12145d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:55:11.007033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-90ceb5d7-ab21-4635-af29-406a12145d42 None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:55:11.008289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-90ceb5d7-ab21-4635-af29-406a12145d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:55:11.015748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1134/2266] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 27 07:55:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:55:11.040537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86d4cb-a18d-40fc-ae7c-f062c816b9fd service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:55:11.053202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86d4cb-a18d-40fc-ae7c-f062c816b9fd service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:55:11.058179 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82a00c-da4a-4e40-a5fe-da0d96889c71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:55:11.058790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82a00c-da4a-4e40-a5fe-da0d96889c71 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:55:11.059103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82a00c-da4a-4e40-a5fe-da0d96889c71 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:55:11.059379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82a00c-da4a-4e40-a5fe-da0d96889c71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:55:11.067900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82a00c-da4a-4e40-a5fe-da0d96889c71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:55:11.069528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82a00c-da4a-4e40-a5fe-da0d96889c71 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:55:11.078061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1133/2267] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:55:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:55:15.753015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ceb5d7-ab21-4635-af29-406a12145d42 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:55:15.766200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ceb5d7-ab21-4635-af29-406a12145d42 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:55:15.771740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93cc7-911e-442e-8856-8125e0690360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:55:15.772346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93cc7-911e-442e-8856-8125e0690360 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:55:15.772628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93cc7-911e-442e-8856-8125e0690360 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:55:15.772903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93cc7-911e-442e-8856-8125e0690360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:55:15.774646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-28c93cc7-911e-442e-8856-8125e0690360 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:55:15.834141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93cc7-911e-442e-8856-8125e0690360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:55:15.835781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93cc7-911e-442e-8856-8125e0690360 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:55:15.845127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1135/2268] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:55:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:55:19.886861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82a00c-da4a-4e40-a5fe-da0d96889c71 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:55:19.896724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82a00c-da4a-4e40-a5fe-da0d96889c71 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:55:19.900360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cfd70-da53-4c7f-8899-1efbddfc8b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:55:19.900975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cfd70-da53-4c7f-8899-1efbddfc8b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:55:19.901254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cfd70-da53-4c7f-8899-1efbddfc8b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:55:19.901534 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cfd70-da53-4c7f-8899-1efbddfc8b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:55:19.911629 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cfd70-da53-4c7f-8899-1efbddfc8b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:55:19.913104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cfd70-da53-4c7f-8899-1efbddfc8b25 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:55:19.922591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1134/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:55:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:55:21.775677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93cc7-911e-442e-8856-8125e0690360 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:55:21.787919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93cc7-911e-442e-8856-8125e0690360 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:55:21.793679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134126-349d-4ee6-aeea-6512fcd1c95c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:55:21.794300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134126-349d-4ee6-aeea-6512fcd1c95c service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:55:21.794584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134126-349d-4ee6-aeea-6512fcd1c95c service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:55:21.794862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134126-349d-4ee6-aeea-6512fcd1c95c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:55:21.796693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-db134126-349d-4ee6-aeea-6512fcd1c95c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:55:21.809843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db134126-349d-4ee6-aeea-6512fcd1c95c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:55:21.811495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db134126-349d-4ee6-aeea-6512fcd1c95c service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:55:21.822293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1136/2270] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:55:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:55:29.918348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=12 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:31.817824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=37 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:46.549139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc6fd4-0788-42b0-a7a5-eacaea93f356 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:55:46.549687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc6fd4-0788-42b0-a7a5-eacaea93f356 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:55:46.549687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc6fd4-0788-42b0-a7a5-eacaea93f356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:55:46.569583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b1cc6fd4-0788-42b0-a7a5-eacaea93f356 None None] MFA Rules not processed for user `cb1cee30bc59446d882880d978b78bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:55:46.570787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b1cc6fd4-0788-42b0-a7a5-eacaea93f356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:55:46.577787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1135/2271] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:55:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:55:53.371424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134126-349d-4ee6-aeea-6512fcd1c95c service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:55:53.384061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134126-349d-4ee6-aeea-6512fcd1c95c service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:55:53.389566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5f218-7a87-4fa0-910a-38a85471be37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:55:53.390182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f218-7a87-4fa0-910a-38a85471be37 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:55:53.390641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f218-7a87-4fa0-910a-38a85471be37 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:55:53.391124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f218-7a87-4fa0-910a-38a85471be37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:55:53.393059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-38a5f218-7a87-4fa0-910a-38a85471be37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:55:53.471213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5f218-7a87-4fa0-910a-38a85471be37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:55:53.473317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5f218-7a87-4fa0-910a-38a85471be37 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:55:53.484659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1137/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:55:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:55:55.529813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc6fd4-0788-42b0-a7a5-eacaea93f356 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:55:55.543402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc6fd4-0788-42b0-a7a5-eacaea93f356 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:55:55.549018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5bb91-0363-4524-8782-2f2bab1219a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:55:55.549652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5bb91-0363-4524-8782-2f2bab1219a2 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:55:55.549930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5bb91-0363-4524-8782-2f2bab1219a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:55:55.550204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5bb91-0363-4524-8782-2f2bab1219a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:55:55.552032 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-03e5bb91-0363-4524-8782-2f2bab1219a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:55:55.610691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5bb91-0363-4524-8782-2f2bab1219a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:55:55.612344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5bb91-0363-4524-8782-2f2bab1219a2 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:55:55.621565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1136/2273] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:55:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:55:59.011739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5f218-7a87-4fa0-910a-38a85471be37 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:55:59.025019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5f218-7a87-4fa0-910a-38a85471be37 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:55:59.031577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793900b5-d87f-473d-9df8-ef8d1b7ca7f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:55:59.032515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793900b5-d87f-473d-9df8-ef8d1b7ca7f2 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:55:59.032794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793900b5-d87f-473d-9df8-ef8d1b7ca7f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:55:59.033063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793900b5-d87f-473d-9df8-ef8d1b7ca7f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:55:59.034974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-793900b5-d87f-473d-9df8-ef8d1b7ca7f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:55:59.049573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793900b5-d87f-473d-9df8-ef8d1b7ca7f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:55:59.051451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793900b5-d87f-473d-9df8-ef8d1b7ca7f2 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:55:59.064318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1138/2274] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:55:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:56:05.617343 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=31 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:09.059632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=34 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:10.031553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ccdcd-88a5-412b-8805-81f5625b8651 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:10.032107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ccdcd-88a5-412b-8805-81f5625b8651 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:10.032396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ccdcd-88a5-412b-8805-81f5625b8651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:10.052106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6e4ccdcd-88a5-412b-8805-81f5625b8651 None None] MFA Rules not processed for user `df8fb928aa42413b9d03e83f46dd48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:56:10.053340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6e4ccdcd-88a5-412b-8805-81f5625b8651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:10.060785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1137/2275] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:56:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:56:20.046506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:21.768834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793900b5-d87f-473d-9df8-ef8d1b7ca7f2 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:56:21.781464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793900b5-d87f-473d-9df8-ef8d1b7ca7f2 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:56:21.788224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886efa84-5148-4137-b9ab-c28e45740a99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:56:21.788836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886efa84-5148-4137-b9ab-c28e45740a99 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:21.789111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886efa84-5148-4137-b9ab-c28e45740a99 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:21.789502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886efa84-5148-4137-b9ab-c28e45740a99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:21.791299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-886efa84-5148-4137-b9ab-c28e45740a99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:21.804883 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886efa84-5148-4137-b9ab-c28e45740a99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:56:21.806525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886efa84-5148-4137-b9ab-c28e45740a99 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:56:21.819371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1139/2276] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:56:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:56:31.814051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:42.294603 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e21997-0ea7-477b-9b84-d3cfe454b4a1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:42.295123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e21997-0ea7-477b-9b84-d3cfe454b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:42.295302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e21997-0ea7-477b-9b84-d3cfe454b4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:42.317096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-81e21997-0ea7-477b-9b84-d3cfe454b4a1 None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:56:42.318389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-81e21997-0ea7-477b-9b84-d3cfe454b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:42.327279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1138/2277] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 27 07:56:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:56:42.383537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886efa84-5148-4137-b9ab-c28e45740a99 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:56:42.395606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886efa84-5148-4137-b9ab-c28e45740a99 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:56:42.401409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550976fe-1bc5-48c1-b9a7-d4576c7dc0a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:56:42.402246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550976fe-1bc5-48c1-b9a7-d4576c7dc0a9 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:42.402619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550976fe-1bc5-48c1-b9a7-d4576c7dc0a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:42.403012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550976fe-1bc5-48c1-b9a7-d4576c7dc0a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:42.418241 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550976fe-1bc5-48c1-b9a7-d4576c7dc0a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:56:42.420911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550976fe-1bc5-48c1-b9a7-d4576c7dc0a9 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:56:42.433560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1140/2278] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:56:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:56:42.826591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e21997-0ea7-477b-9b84-d3cfe454b4a1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:56:42.840095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e21997-0ea7-477b-9b84-d3cfe454b4a1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:56:42.845258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912753d-89e2-4745-bb49-894ba342e86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:56:42.846414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912753d-89e2-4745-bb49-894ba342e86d service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:42.846779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912753d-89e2-4745-bb49-894ba342e86d service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:42.847545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912753d-89e2-4745-bb49-894ba342e86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:42.850467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6912753d-89e2-4745-bb49-894ba342e86d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:42.940622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912753d-89e2-4745-bb49-894ba342e86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:56:42.942606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912753d-89e2-4745-bb49-894ba342e86d service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:56:42.953413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1139/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:56:44.876031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61327d-be01-468c-b8c2-6fbdc7bdc719 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:44.876548 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61327d-be01-468c-b8c2-6fbdc7bdc719 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:44.876630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61327d-be01-468c-b8c2-6fbdc7bdc719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:44.899205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4c61327d-be01-468c-b8c2-6fbdc7bdc719 None None] MFA Rules not processed for user `eb3d3ca2457b47a29b7c94bd8be450cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:56:44.900947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4c61327d-be01-468c-b8c2-6fbdc7bdc719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:44.907922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1141/2280] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:56:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:56:45.455827 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912753d-89e2-4745-bb49-894ba342e86d service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:56:45.465800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912753d-89e2-4745-bb49-894ba342e86d service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:56:45.469562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:56:45.470187 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:45.470468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:45.470736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:45.473382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:45.483494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:56:45.484933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:56:45.505444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1140/2281] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:56:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:56:46.925107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61327d-be01-468c-b8c2-6fbdc7bdc719 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:56:46.937670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61327d-be01-468c-b8c2-6fbdc7bdc719 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:56:46.943141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1a198-3c7a-4d7d-8025-0db73384a8ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:56:46.943759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1a198-3c7a-4d7d-8025-0db73384a8ea service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:46.944039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1a198-3c7a-4d7d-8025-0db73384a8ea service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:46.944331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1a198-3c7a-4d7d-8025-0db73384a8ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:46.946406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-57a1a198-3c7a-4d7d-8025-0db73384a8ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:46.960617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1a198-3c7a-4d7d-8025-0db73384a8ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:56:46.962235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1a198-3c7a-4d7d-8025-0db73384a8ea service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:56:46.979513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1142/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:56:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:56:51.234837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:56:51.237065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:51.299513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906d59-2e82-4e3e-bbf3-d4e1625747c7 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:56:51.312623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:56:51.313292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:51.314495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:51.314811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] PATH_INFO: `/v3/users/08692d3eaab8431f8af3da2c1e098ec3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:51.316424 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] RBAC: Authorizing `identity:delete_user(user_id=08692d3eaab8431f8af3da2c1e098ec3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:56:51.329734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:56:51.436932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08692d3eaab8431f8af3da2c1e098ec3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:51.452311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08692d3eaab8431f8af3da2c1e098ec3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:51.453158 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08692d3eaab8431f8af3da2c1e098ec3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:51.467400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08692d3eaab8431f8af3da2c1e098ec3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:51.469652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08692d3eaab8431f8af3da2c1e098ec3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:51.498137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1141/2283] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:56:51 2022] DELETE /identity/v3/users/08692d3eaab8431f8af3da2c1e098ec3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:56:51.809475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1a198-3c7a-4d7d-8025-0db73384a8ea service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:56:51.827436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1a198-3c7a-4d7d-8025-0db73384a8ea service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:56:51.921135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:56:51.922371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:51.923000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:51.923598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] PATH_INFO: `/v3/projects/4271996d22bc4364a5554c0fbff0378b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:51.925446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4271996d22bc4364a5554c0fbff0378b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:56:51.927847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:56:52.008434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4271996d22bc4364a5554c0fbff0378b', 'request_id': 'req-fa2378b1-a776-4a9d-9b53-08c95b5da626'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.018949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4271996d22bc4364a5554c0fbff0378b', 'request_id': 'req-fa2378b1-a776-4a9d-9b53-08c95b5da626'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.036051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4271996d22bc4364a5554c0fbff0378b', 'request_id': 'req-fa2378b1-a776-4a9d-9b53-08c95b5da626'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.052772 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] The token cache is being invalidate because project 4271996d22bc4364a5554c0fbff0378b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:56:52.053265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.054039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fa2378b1-a776-4a9d-9b53-08c95b5da626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.056239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1143/2284] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:56:51 2022] DELETE /identity/v3/projects/4271996d22bc4364a5554c0fbff0378b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:56:52.060454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:56:52.061991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:52.077872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f065-3625-40f9-aca4-fd6dcdac121e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:56:52.137649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:52.156941 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:56:52.158255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:52.158642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:52.159060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] PATH_INFO: `/v3/users/c1ab47635281466eb7980832292209c8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:52.161203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ab47635281466eb7980832292209c8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:56:52.163599 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:56:52.224597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ab47635281466eb7980832292209c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.237020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ab47635281466eb7980832292209c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.237945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ab47635281466eb7980832292209c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.246008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ab47635281466eb7980832292209c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.246802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ab47635281466eb7980832292209c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.263628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1142/2285] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:56:52 2022] DELETE /identity/v3/users/c1ab47635281466eb7980832292209c8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:56:52.450635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144981-edf1-47b5-9a86-85a1cdff9fbb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:52.450970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144981-edf1-47b5-9a86-85a1cdff9fbb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:52.451251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144981-edf1-47b5-9a86-85a1cdff9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:52.470755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:56:52.473676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:52.478153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-90144981-edf1-47b5-9a86-85a1cdff9fbb None None] MFA Rules not processed for user `5efb3ea424f8450c883d4757545af18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:56:52.479550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-90144981-edf1-47b5-9a86-85a1cdff9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:56:52.541455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136ce4-4a43-4e27-b8cc-6ad6d46a96e8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:56:52.546324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:56:52.546990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:56:52.547267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:56:52.547532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] PATH_INFO: `/v3/projects/1bb8161e2cd74285a63f7a76164d21b8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:56:52.548683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb8161e2cd74285a63f7a76164d21b8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:56:52.550624 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:56:52.552371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1144/2286] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:56:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:56:52.605468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb8161e2cd74285a63f7a76164d21b8', 'request_id': 'req-6d2d5fcf-1777-461d-ba7c-fed293be928f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.615751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb8161e2cd74285a63f7a76164d21b8', 'request_id': 'req-6d2d5fcf-1777-461d-ba7c-fed293be928f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.624662 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb8161e2cd74285a63f7a76164d21b8', 'request_id': 'req-6d2d5fcf-1777-461d-ba7c-fed293be928f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.627139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:52.639620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] The token cache is being invalidate because project 1bb8161e2cd74285a63f7a76164d21b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:56:52.639746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.640335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6d2d5fcf-1777-461d-ba7c-fed293be928f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:56:52.642572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1143/2287] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:56:52 2022] DELETE /identity/v3/projects/1bb8161e2cd74285a63f7a76164d21b8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:57:02.545585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:02.644011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:22.799953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90144981-edf1-47b5-9a86-85a1cdff9fbb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:22.801432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-90144981-edf1-47b5-9a86-85a1cdff9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:22.864060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90144981-edf1-47b5-9a86-85a1cdff9fbb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:22.919876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:22.920009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:22.920228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:22.920497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:22.922253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:22.990425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:22.992137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:23.002900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1145/2288] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:57:24.381141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20914a-5828-4a31-a153-9da8e9f55f6c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:24.382012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20914a-5828-4a31-a153-9da8e9f55f6c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:24.382012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20914a-5828-4a31-a153-9da8e9f55f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:24.402035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4e20914a-5828-4a31-a153-9da8e9f55f6c None None] MFA Rules not processed for user `7e3a5b392d9d44859110f048bea7331b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:57:24.403303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4e20914a-5828-4a31-a153-9da8e9f55f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:24.468886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1144/2289] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:57:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:57:26.572784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:26.574255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:26.656409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:26.658531 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af6b78-2d47-4617-8340-d0af6d7eea82 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:26.663601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:26.664253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:26.664579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:26.664860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] PATH_INFO: `/v3/users/cb1cee30bc59446d882880d978b78bc2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:26.666043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1cee30bc59446d882880d978b78bc2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:26.668072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:26.717382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1cee30bc59446d882880d978b78bc2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:26.726557 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1cee30bc59446d882880d978b78bc2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:26.738726 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1cee30bc59446d882880d978b78bc2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:26.740090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1cee30bc59446d882880d978b78bc2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:26.747438 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-60bd1843-7578-4ff5-8767-0c4c435d51dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1cee30bc59446d882880d978b78bc2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:26.753689 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1146/2290] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:57:26 2022] DELETE /identity/v3/users/cb1cee30bc59446d882880d978b78bc2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:57:26.963010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20914a-5828-4a31-a153-9da8e9f55f6c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:27.018841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20914a-5828-4a31-a153-9da8e9f55f6c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:27.080315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:27.081267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.081546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.081817 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] PATH_INFO: `/v3/projects/c8e43fa41dc8445abed15accf9163b32` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.083048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e43fa41dc8445abed15accf9163b32)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:27.085566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:27.136808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e43fa41dc8445abed15accf9163b32', 'request_id': 'req-eb00d1cc-c283-410c-98ea-c022392720a0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:27.144549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e43fa41dc8445abed15accf9163b32', 'request_id': 'req-eb00d1cc-c283-410c-98ea-c022392720a0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:27.150854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e43fa41dc8445abed15accf9163b32', 'request_id': 'req-eb00d1cc-c283-410c-98ea-c022392720a0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:27.162525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] The token cache is being invalidate because project c8e43fa41dc8445abed15accf9163b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:57:27.162813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:27.163494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb00d1cc-c283-410c-98ea-c022392720a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:27.165285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1145/2291] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:57:26 2022] DELETE /identity/v3/projects/c8e43fa41dc8445abed15accf9163b32 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:57:27.169981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d122022-42e4-492e-891b-cb8d9cface11 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.170266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d122022-42e4-492e-891b-cb8d9cface11 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.170569 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d122022-42e4-492e-891b-cb8d9cface11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.257108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7d122022-42e4-492e-891b-cb8d9cface11 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:57:27.258463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7d122022-42e4-492e-891b-cb8d9cface11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:27.330016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1147/2292] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:57:27.339325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92a2f7-e710-48fc-931b-170c60b0d8ca None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.339881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92a2f7-e710-48fc-931b-170c60b0d8ca None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.340310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92a2f7-e710-48fc-931b-170c60b0d8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.363889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cc92a2f7-e710-48fc-931b-170c60b0d8ca None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:57:27.365524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cc92a2f7-e710-48fc-931b-170c60b0d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:27.374918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1146/2293] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:57:27.379240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d122022-42e4-492e-891b-cb8d9cface11 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:27.392678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d122022-42e4-492e-891b-cb8d9cface11 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:27.398206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b7ea8-2a56-4c79-bc95-dc07dbe7dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:27.398826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b7ea8-2a56-4c79-bc95-dc07dbe7dd43 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.399151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b7ea8-2a56-4c79-bc95-dc07dbe7dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.399422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b7ea8-2a56-4c79-bc95-dc07dbe7dd43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.400127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b7ea8-2a56-4c79-bc95-dc07dbe7dd43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:57:27.400431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b7ea8-2a56-4c79-bc95-dc07dbe7dd43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:27.402119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b7ea8-2a56-4c79-bc95-dc07dbe7dd43 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:27.415008 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1148/2294] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:57:27.419310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92a2f7-e710-48fc-931b-170c60b0d8ca None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:27.429384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92a2f7-e710-48fc-931b-170c60b0d8ca None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:27.435425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176ebd9-7b34-4e28-873e-c2ca6b78934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:27.436401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176ebd9-7b34-4e28-873e-c2ca6b78934b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.437322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176ebd9-7b34-4e28-873e-c2ca6b78934b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.437761 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176ebd9-7b34-4e28-873e-c2ca6b78934b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.439009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176ebd9-7b34-4e28-873e-c2ca6b78934b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:27.442034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176ebd9-7b34-4e28-873e-c2ca6b78934b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:27.455510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:27.486030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1147/2295] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:57:27 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:57:27.487005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b7ea8-2a56-4c79-bc95-dc07dbe7dd43 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:27.498172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b7ea8-2a56-4c79-bc95-dc07dbe7dd43 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:27.544823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:27.579308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135191f-c5b4-4837-93f1-b9fbff19aa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:27.579955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135191f-c5b4-4837-93f1-b9fbff19aa8b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.580283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135191f-c5b4-4837-93f1-b9fbff19aa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.580465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135191f-c5b4-4837-93f1-b9fbff19aa8b admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.581320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135191f-c5b4-4837-93f1-b9fbff19aa8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:27.584087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135191f-c5b4-4837-93f1-b9fbff19aa8b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:27.613568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1149/2296] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:57:27 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:57:27.617597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176ebd9-7b34-4e28-873e-c2ca6b78934b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:27.628076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176ebd9-7b34-4e28-873e-c2ca6b78934b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:27.633738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbef835-b95e-40e1-8473-a27e304531fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:27.634260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef835-b95e-40e1-8473-a27e304531fa admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.634668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef835-b95e-40e1-8473-a27e304531fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.635053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef835-b95e-40e1-8473-a27e304531fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.635766 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbef835-b95e-40e1-8473-a27e304531fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:27.637394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbef835-b95e-40e1-8473-a27e304531fa admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:27.651704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1148/2297] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:57:27.652887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135191f-c5b4-4837-93f1-b9fbff19aa8b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:27.663457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135191f-c5b4-4837-93f1-b9fbff19aa8b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:27.668196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd1474-fa95-402e-b401-1f8eb0fd5c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:27.668809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd1474-fa95-402e-b401-1f8eb0fd5c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.669085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd1474-fa95-402e-b401-1f8eb0fd5c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.669352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd1474-fa95-402e-b401-1f8eb0fd5c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.670049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd1474-fa95-402e-b401-1f8eb0fd5c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:27.671678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd1474-fa95-402e-b401-1f8eb0fd5c59 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:27.682088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1150/2298] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:57:27.686498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbef835-b95e-40e1-8473-a27e304531fa admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:27.704158 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbef835-b95e-40e1-8473-a27e304531fa admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:27.710559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889a881-d04f-42fa-9ec4-32014730cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:27.711275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889a881-d04f-42fa-9ec4-32014730cc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.711556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889a881-d04f-42fa-9ec4-32014730cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.711829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889a881-d04f-42fa-9ec4-32014730cc0a admin admin] PATH_INFO: `/v3/projects/0414303787b14430b270aa3f356d23b5/users/44029f6115b14b4ba36c66871d43a188/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.733006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889a881-d04f-42fa-9ec4-32014730cc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0414303787b14430b270aa3f356d23b5, user_id=44029f6115b14b4ba36c66871d43a188, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:27.735778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889a881-d04f-42fa-9ec4-32014730cc0a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:27.750230 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1149/2299] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:57:27 2022] PUT /identity/v3/projects/0414303787b14430b270aa3f356d23b5/users/44029f6115b14b4ba36c66871d43a188/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:57:27.761765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f4335-6bb7-4303-b590-0de7a68622bf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:27.762057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f4335-6bb7-4303-b590-0de7a68622bf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:27.762336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f4335-6bb7-4303-b590-0de7a68622bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:27.798781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-271f4335-6bb7-4303-b590-0de7a68622bf None None] MFA Rules not processed for user `44029f6115b14b4ba36c66871d43a188`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:57:27.800158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-271f4335-6bb7-4303-b590-0de7a68622bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:27.877987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1151/2300] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:57:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:57:27.890336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889a881-d04f-42fa-9ec4-32014730cc0a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:27.892288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c889a881-d04f-42fa-9ec4-32014730cc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:28.041077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889a881-d04f-42fa-9ec4-32014730cc0a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:28.048143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5cb55-e00d-4117-9f69-50c7b8b191cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:28.049139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5cb55-e00d-4117-9f69-50c7b8b191cf service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:28.049386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5cb55-e00d-4117-9f69-50c7b8b191cf service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:28.049763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5cb55-e00d-4117-9f69-50c7b8b191cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:28.067843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5cb55-e00d-4117-9f69-50c7b8b191cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:28.070308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5cb55-e00d-4117-9f69-50c7b8b191cf service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:28.087734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1150/2301] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:57:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:57:28.345110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f4335-6bb7-4303-b590-0de7a68622bf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:28.408653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f4335-6bb7-4303-b590-0de7a68622bf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:28.414343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:28.415055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:28.415336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:28.415608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] PATH_INFO: `/v3/users/44029f6115b14b4ba36c66871d43a188` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:28.416798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44029f6115b14b4ba36c66871d43a188)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:28.418753 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:28.471640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:28.475358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44029f6115b14b4ba36c66871d43a188'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:28.484915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44029f6115b14b4ba36c66871d43a188'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:28.498343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44029f6115b14b4ba36c66871d43a188'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:28.499050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44029f6115b14b4ba36c66871d43a188'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:28.506665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44029f6115b14b4ba36c66871d43a188'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:28.513184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1152/2302] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:57:28 2022] DELETE /identity/v3/users/44029f6115b14b4ba36c66871d43a188 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:57:28.517840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b8c38-ce09-4677-bf98-160b02b7e348 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:28.518124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b8c38-ce09-4677-bf98-160b02b7e348 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:28.518399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b8c38-ce09-4677-bf98-160b02b7e348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:28.539124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3f3b8c38-ce09-4677-bf98-160b02b7e348 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:57:28.540359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3f3b8c38-ce09-4677-bf98-160b02b7e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:28.592010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:28.603028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1151/2303] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:57:28.612934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:28.614482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:28.672777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476729be-5403-4c11-8e60-10730f6fbc9a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:28.676739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb3acc-6b05-4962-a231-a553b952b88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:28.677609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb3acc-6b05-4962-a231-a553b952b88a service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:28.677975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb3acc-6b05-4962-a231-a553b952b88a service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:28.678255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb3acc-6b05-4962-a231-a553b952b88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:28.687915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb3acc-6b05-4962-a231-a553b952b88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:28.689532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb3acc-6b05-4962-a231-a553b952b88a service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:28.700267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1153/2304] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:57:28.983447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b8c38-ce09-4677-bf98-160b02b7e348 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:28.984915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3f3b8c38-ce09-4677-bf98-160b02b7e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:28.997913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b8c38-ce09-4677-bf98-160b02b7e348 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.002582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.003246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.003529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.003802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] PATH_INFO: `/v3/projects/0414303787b14430b270aa3f356d23b5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.005612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0414303787b14430b270aa3f356d23b5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.007581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.053991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0414303787b14430b270aa3f356d23b5', 'request_id': 'req-4dbe3a2e-a598-42d0-8431-e7673a2013ee'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:29.061253 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0414303787b14430b270aa3f356d23b5', 'request_id': 'req-4dbe3a2e-a598-42d0-8431-e7673a2013ee'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:29.066928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0414303787b14430b270aa3f356d23b5', 'request_id': 'req-4dbe3a2e-a598-42d0-8431-e7673a2013ee'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:29.078744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] The token cache is being invalidate because project 0414303787b14430b270aa3f356d23b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:57:29.079064 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:29.079710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4dbe3a2e-a598-42d0-8431-e7673a2013ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:57:29.081240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1152/2305] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:57:28 2022] DELETE /identity/v3/projects/0414303787b14430b270aa3f356d23b5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:57:29.086305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb351ca-f4cf-4c37-a320-1d8afbf49be1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.086596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb351ca-f4cf-4c37-a320-1d8afbf49be1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.086874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb351ca-f4cf-4c37-a320-1d8afbf49be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.106217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-abb351ca-f4cf-4c37-a320-1d8afbf49be1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:57:29.107473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-abb351ca-f4cf-4c37-a320-1d8afbf49be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:29.166680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1154/2306] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:57:29.174449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f895a-0cd6-4f3c-a7b9-b1ef982558b3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.174732 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f895a-0cd6-4f3c-a7b9-b1ef982558b3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.175037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f895a-0cd6-4f3c-a7b9-b1ef982558b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.195415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-136f895a-0cd6-4f3c-a7b9-b1ef982558b3 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:57:29.196638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-136f895a-0cd6-4f3c-a7b9-b1ef982558b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:29.204536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1153/2307] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:57:29.208697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb351ca-f4cf-4c37-a320-1d8afbf49be1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.218132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb351ca-f4cf-4c37-a320-1d8afbf49be1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.222936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1b23-f379-4997-a450-ded11d2d79c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.223534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1b23-f379-4997-a450-ded11d2d79c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.224305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1b23-f379-4997-a450-ded11d2d79c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.224575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1b23-f379-4997-a450-ded11d2d79c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.225263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1b23-f379-4997-a450-ded11d2d79c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:57:29.225560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1b23-f379-4997-a450-ded11d2d79c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.227175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1b23-f379-4997-a450-ded11d2d79c5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.238489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1155/2308] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:57:29.243519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f895a-0cd6-4f3c-a7b9-b1ef982558b3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.252712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f895a-0cd6-4f3c-a7b9-b1ef982558b3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.257471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd8dbc-9394-4ebd-b0f8-edcddf592dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.258077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd8dbc-9394-4ebd-b0f8-edcddf592dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.258349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd8dbc-9394-4ebd-b0f8-edcddf592dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.258616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd8dbc-9394-4ebd-b0f8-edcddf592dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.259322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd8dbc-9394-4ebd-b0f8-edcddf592dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.261210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd8dbc-9394-4ebd-b0f8-edcddf592dc3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.288110 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1154/2309] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:57:29 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:57:29.292715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1b23-f379-4997-a450-ded11d2d79c5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.304131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1b23-f379-4997-a450-ded11d2d79c5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.350339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:29.361430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72345fa6-d51a-449d-b7e2-b427ba608660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.362041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345fa6-d51a-449d-b7e2-b427ba608660 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.362317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345fa6-d51a-449d-b7e2-b427ba608660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.362585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345fa6-d51a-449d-b7e2-b427ba608660 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.363294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72345fa6-d51a-449d-b7e2-b427ba608660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.365792 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72345fa6-d51a-449d-b7e2-b427ba608660 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.386228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1156/2310] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:57:29 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:57:29.390558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd8dbc-9394-4ebd-b0f8-edcddf592dc3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.401034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd8dbc-9394-4ebd-b0f8-edcddf592dc3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.405626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157a0a1-2893-4438-b276-963bce9131f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.406234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157a0a1-2893-4438-b276-963bce9131f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.406515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157a0a1-2893-4438-b276-963bce9131f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.406819 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157a0a1-2893-4438-b276-963bce9131f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.407549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157a0a1-2893-4438-b276-963bce9131f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.409149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157a0a1-2893-4438-b276-963bce9131f5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.419400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1155/2311] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:57:29.423659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72345fa6-d51a-449d-b7e2-b427ba608660 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.434791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72345fa6-d51a-449d-b7e2-b427ba608660 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.439504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e41fe9-3906-4b0e-9f5d-4e312498f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.440112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41fe9-3906-4b0e-9f5d-4e312498f8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.440417 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41fe9-3906-4b0e-9f5d-4e312498f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.440668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41fe9-3906-4b0e-9f5d-4e312498f8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.441368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e41fe9-3906-4b0e-9f5d-4e312498f8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.443004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e41fe9-3906-4b0e-9f5d-4e312498f8e4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.453681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1157/2312] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:57:29.459117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157a0a1-2893-4438-b276-963bce9131f5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.472437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157a0a1-2893-4438-b276-963bce9131f5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.477823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0963ef-93ef-4158-bb2d-a9fb53f9866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.485412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0963ef-93ef-4158-bb2d-a9fb53f9866b admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.485692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0963ef-93ef-4158-bb2d-a9fb53f9866b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.485966 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0963ef-93ef-4158-bb2d-a9fb53f9866b admin admin] PATH_INFO: `/v3/projects/aa3492e5cda34918b819621e2c1ad863/users/dea19008797d4c9ca3c37c21c203a7db/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.509483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0963ef-93ef-4158-bb2d-a9fb53f9866b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3492e5cda34918b819621e2c1ad863, user_id=dea19008797d4c9ca3c37c21c203a7db, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.512223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0963ef-93ef-4158-bb2d-a9fb53f9866b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.526164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1156/2313] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:57:29 2022] PUT /identity/v3/projects/aa3492e5cda34918b819621e2c1ad863/users/dea19008797d4c9ca3c37c21c203a7db/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:57:29.538353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd82ef-8c04-4af4-a519-6e8948cc1925 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.538637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd82ef-8c04-4af4-a519-6e8948cc1925 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.538940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd82ef-8c04-4af4-a519-6e8948cc1925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.566346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f1dd82ef-8c04-4af4-a519-6e8948cc1925 None None] MFA Rules not processed for user `dea19008797d4c9ca3c37c21c203a7db`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:57:29.567584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f1dd82ef-8c04-4af4-a519-6e8948cc1925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:29.631914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1158/2314] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:57:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:57:29.636539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0963ef-93ef-4158-bb2d-a9fb53f9866b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.697188 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0963ef-93ef-4158-bb2d-a9fb53f9866b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.701824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3145f3-901b-446a-b8ed-8e917c57e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.702492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3145f3-901b-446a-b8ed-8e917c57e2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.702724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3145f3-901b-446a-b8ed-8e917c57e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.703055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3145f3-901b-446a-b8ed-8e917c57e2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.703729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3145f3-901b-446a-b8ed-8e917c57e2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.705657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3145f3-901b-446a-b8ed-8e917c57e2f9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.732803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1157/2315] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:57:29 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:57:29.737100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd82ef-8c04-4af4-a519-6e8948cc1925 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.748245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd82ef-8c04-4af4-a519-6e8948cc1925 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.808952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6466ed-dc00-401b-9b4c-fa52c35728e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.809583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6466ed-dc00-401b-9b4c-fa52c35728e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.809859 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6466ed-dc00-401b-9b4c-fa52c35728e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.810128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6466ed-dc00-401b-9b4c-fa52c35728e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.810798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6466ed-dc00-401b-9b4c-fa52c35728e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.812861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6466ed-dc00-401b-9b4c-fa52c35728e8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.837505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1159/2316] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:57:29 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:57:29.842070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3145f3-901b-446a-b8ed-8e917c57e2f9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.847996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:29.855355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3145f3-901b-446a-b8ed-8e917c57e2f9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.861685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2f46-e98d-46fb-b8b3-c51c2a850c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.862301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2f46-e98d-46fb-b8b3-c51c2a850c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.862584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2f46-e98d-46fb-b8b3-c51c2a850c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.862859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2f46-e98d-46fb-b8b3-c51c2a850c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.863591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c2f46-e98d-46fb-b8b3-c51c2a850c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.865748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c2f46-e98d-46fb-b8b3-c51c2a850c54 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.876689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1158/2317] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:57:29.882412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6466ed-dc00-401b-9b4c-fa52c35728e8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.892985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6466ed-dc00-401b-9b4c-fa52c35728e8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:29.897789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922a5b3-1cfa-41aa-9d54-330c320d4a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:29.898463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922a5b3-1cfa-41aa-9d54-330c320d4a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:29.898743 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922a5b3-1cfa-41aa-9d54-330c320d4a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:29.899050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922a5b3-1cfa-41aa-9d54-330c320d4a67 admin admin] PATH_INFO: `/v3/projects/aa9819d967084262940dcedf603c3361/users/56ef18d534274ac49b4cdd4685449b71/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:29.915501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922a5b3-1cfa-41aa-9d54-330c320d4a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9819d967084262940dcedf603c3361, user_id=56ef18d534274ac49b4cdd4685449b71, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:29.918172 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922a5b3-1cfa-41aa-9d54-330c320d4a67 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:29.932678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1160/2318] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:57:29 2022] PUT /identity/v3/projects/aa9819d967084262940dcedf603c3361/users/56ef18d534274ac49b4cdd4685449b71/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:57:29.936803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2f46-e98d-46fb-b8b3-c51c2a850c54 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:29.947502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2f46-e98d-46fb-b8b3-c51c2a850c54 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:30.011472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa512cb-80bd-4e5d-9309-2e1d576436d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:30.012112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa512cb-80bd-4e5d-9309-2e1d576436d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:30.012394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa512cb-80bd-4e5d-9309-2e1d576436d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:30.012668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa512cb-80bd-4e5d-9309-2e1d576436d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:30.013381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa512cb-80bd-4e5d-9309-2e1d576436d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:30.015018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa512cb-80bd-4e5d-9309-2e1d576436d2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:30.025246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1159/2319] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:57:30.029544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922a5b3-1cfa-41aa-9d54-330c320d4a67 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:30.040425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922a5b3-1cfa-41aa-9d54-330c320d4a67 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:30.045099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964f0f-a7a0-4f39-8124-0be764168077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:30.045766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964f0f-a7a0-4f39-8124-0be764168077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:30.046119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964f0f-a7a0-4f39-8124-0be764168077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:30.046397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964f0f-a7a0-4f39-8124-0be764168077 admin admin] PATH_INFO: `/v3/projects/aa9819d967084262940dcedf603c3361/users/56ef18d534274ac49b4cdd4685449b71/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:30.048432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964f0f-a7a0-4f39-8124-0be764168077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9819d967084262940dcedf603c3361, user_id=56ef18d534274ac49b4cdd4685449b71, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:30.051236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964f0f-a7a0-4f39-8124-0be764168077 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:30.062502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1161/2320] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:57:30 2022] PUT /identity/v3/projects/aa9819d967084262940dcedf603c3361/users/56ef18d534274ac49b4cdd4685449b71/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:57:30.073978 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9c86e-d943-4cd6-84e5-810c80b1c1a4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:30.074503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9c86e-d943-4cd6-84e5-810c80b1c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:30.074503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9c86e-d943-4cd6-84e5-810c80b1c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:30.104816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1ec9c86e-d943-4cd6-84e5-810c80b1c1a4 None None] MFA Rules not processed for user `56ef18d534274ac49b4cdd4685449b71`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:57:30.105975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1ec9c86e-d943-4cd6-84e5-810c80b1c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:30.179745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1160/2321] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:57:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:57:30.191940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964f0f-a7a0-4f39-8124-0be764168077 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:30.194203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68964f0f-a7a0-4f39-8124-0be764168077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:30.209188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:30.255573 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964f0f-a7a0-4f39-8124-0be764168077 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:30.259475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06ff1-6c67-4554-9a40-8da8361a1f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:30.260101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06ff1-6c67-4554-9a40-8da8361a1f25 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:30.260383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06ff1-6c67-4554-9a40-8da8361a1f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:30.260657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06ff1-6c67-4554-9a40-8da8361a1f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:30.269911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec06ff1-6c67-4554-9a40-8da8361a1f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:30.271977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec06ff1-6c67-4554-9a40-8da8361a1f25 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:30.281425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1162/2322] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:57:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:57:30.356661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9c86e-d943-4cd6-84e5-810c80b1c1a4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:30.367160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9c86e-d943-4cd6-84e5-810c80b1c1a4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:30.370976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c90ba3-b900-4945-a8e5-eec76b834edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:30.371586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c90ba3-b900-4945-a8e5-eec76b834edc service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:30.371867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c90ba3-b900-4945-a8e5-eec76b834edc service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:30.372138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c90ba3-b900-4945-a8e5-eec76b834edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:30.430745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c90ba3-b900-4945-a8e5-eec76b834edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:30.432271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c90ba3-b900-4945-a8e5-eec76b834edc service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:30.441227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1161/2323] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:57:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:57:38.220619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06ff1-6c67-4554-9a40-8da8361a1f25 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:57:38.222591 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5ec06ff1-6c67-4554-9a40-8da8361a1f25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:38.333844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06ff1-6c67-4554-9a40-8da8361a1f25 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:57:38.339072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b88c17-8b5d-4535-9bb5-3e6eacf8c4dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:57:38.339703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88c17-8b5d-4535-9bb5-3e6eacf8c4dc service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:57:38.339986 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88c17-8b5d-4535-9bb5-3e6eacf8c4dc service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:57:38.340266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88c17-8b5d-4535-9bb5-3e6eacf8c4dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:57:38.342213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-10b88c17-8b5d-4535-9bb5-3e6eacf8c4dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:57:38.355065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b88c17-8b5d-4535-9bb5-3e6eacf8c4dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:57:38.356687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b88c17-8b5d-4535-9bb5-3e6eacf8c4dc service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:57:38.367719 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1163/2324] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:57:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:57:40.437114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:48.362662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=62 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:17.224513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c90ba3-b900-4945-a8e5-eec76b834edc service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:17.291874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c90ba3-b900-4945-a8e5-eec76b834edc service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:17.296703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:17.297356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:17.297654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:17.297928 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] PATH_INFO: `/v3/users/dea19008797d4c9ca3c37c21c203a7db` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:17.299197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea19008797d4c9ca3c37c21c203a7db)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:17.301621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:17.350391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea19008797d4c9ca3c37c21c203a7db'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:17.362960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea19008797d4c9ca3c37c21c203a7db'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:17.363706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea19008797d4c9ca3c37c21c203a7db'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:17.371851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea19008797d4c9ca3c37c21c203a7db'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:17.372569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea19008797d4c9ca3c37c21c203a7db'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:17.386368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1162/2325] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:17 2022] DELETE /identity/v3/users/dea19008797d4c9ca3c37c21c203a7db => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:17.390939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4219077-436d-4319-b6ed-af3abe65f731 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:17.391496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4219077-436d-4319-b6ed-af3abe65f731 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:17.391760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4219077-436d-4319-b6ed-af3abe65f731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:17.425651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a4219077-436d-4319-b6ed-af3abe65f731 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:17.427264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a4219077-436d-4319-b6ed-af3abe65f731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:17.492869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1164/2326] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:17.505523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:17.508194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:17.608302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be900d-3a9d-47cb-a7f2-933db7cad5b2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:17.612077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03f373-48e0-4e89-a73e-eb41314184d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:17.613196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03f373-48e0-4e89-a73e-eb41314184d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:17.613450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03f373-48e0-4e89-a73e-eb41314184d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:17.614543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03f373-48e0-4e89-a73e-eb41314184d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:17.626529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03f373-48e0-4e89-a73e-eb41314184d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:17.628035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03f373-48e0-4e89-a73e-eb41314184d8 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:17.639719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1163/2327] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:17.947046 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4219077-436d-4319-b6ed-af3abe65f731 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:17.948568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a4219077-436d-4319-b6ed-af3abe65f731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:17.961012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4219077-436d-4319-b6ed-af3abe65f731 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:17.965742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:17.966328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:17.966612 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:17.967051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] PATH_INFO: `/v3/projects/aa3492e5cda34918b819621e2c1ad863` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:17.968094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3492e5cda34918b819621e2c1ad863)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:17.970027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:18.023340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3492e5cda34918b819621e2c1ad863', 'request_id': 'req-2730d280-cc6f-4b44-b42b-77871ffd8229'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.032034 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3492e5cda34918b819621e2c1ad863', 'request_id': 'req-2730d280-cc6f-4b44-b42b-77871ffd8229'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.037925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3492e5cda34918b819621e2c1ad863', 'request_id': 'req-2730d280-cc6f-4b44-b42b-77871ffd8229'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.050295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] The token cache is being invalidate because project aa3492e5cda34918b819621e2c1ad863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:18.050579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.051267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.052790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1165/2328] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:17 2022] DELETE /identity/v3/projects/aa3492e5cda34918b819621e2c1ad863 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:18.057327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03f373-48e0-4e89-a73e-eb41314184d8 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:18.062376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:18.068640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03f373-48e0-4e89-a73e-eb41314184d8 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:18.131121 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:18.131777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:18.132056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:18.132324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] PATH_INFO: `/v3/users/56ef18d534274ac49b4cdd4685449b71` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:18.133577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ef18d534274ac49b4cdd4685449b71)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:18.135542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:18.194958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ef18d534274ac49b4cdd4685449b71'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.212366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ef18d534274ac49b4cdd4685449b71'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.213685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ef18d534274ac49b4cdd4685449b71'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.230126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ef18d534274ac49b4cdd4685449b71'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.231168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-bea1598c-2379-4882-ae83-6b0a21c6021a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ef18d534274ac49b4cdd4685449b71'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.253059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1164/2329] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:18 2022] DELETE /identity/v3/users/56ef18d534274ac49b4cdd4685449b71 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:18.707683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:18.709794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:18.737014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730d280-cc6f-4b44-b42b-77871ffd8229 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:18.826233 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:18.826993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:18.827238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:18.827874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] PATH_INFO: `/v3/projects/aa9819d967084262940dcedf603c3361` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:18.828844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9819d967084262940dcedf603c3361)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:18.830806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:18.863978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:18.888381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9819d967084262940dcedf603c3361', 'request_id': 'req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.896076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9819d967084262940dcedf603c3361', 'request_id': 'req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.902634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9819d967084262940dcedf603c3361', 'request_id': 'req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.913882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] The token cache is being invalidate because project aa9819d967084262940dcedf603c3361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:18.914183 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.914844 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9902a01e-09b4-4ef0-a3e4-5bfaf3db5f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:18.916483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1166/2330] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:18 2022] DELETE /identity/v3/projects/aa9819d967084262940dcedf603c3361 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:18.921452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e65fc-8f81-489b-96e8-5c4d69412d93 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:18.921739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e65fc-8f81-489b-96e8-5c4d69412d93 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:18.922009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e65fc-8f81-489b-96e8-5c4d69412d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:18.942653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-262e65fc-8f81-489b-96e8-5c4d69412d93 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:18.943940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-262e65fc-8f81-489b-96e8-5c4d69412d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:19.017354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1165/2331] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:58:19.027252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03453f80-75f8-4e76-9a7d-6aa112b3d763 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.027678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03453f80-75f8-4e76-9a7d-6aa112b3d763 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.028052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03453f80-75f8-4e76-9a7d-6aa112b3d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.060465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-03453f80-75f8-4e76-9a7d-6aa112b3d763 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:19.061780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-03453f80-75f8-4e76-9a7d-6aa112b3d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:19.074236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1167/2332] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:19.077027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e65fc-8f81-489b-96e8-5c4d69412d93 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.090958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e65fc-8f81-489b-96e8-5c4d69412d93 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.096248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b59c7-725d-448f-ad91-5cf1cc84e6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.097138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b59c7-725d-448f-ad91-5cf1cc84e6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.097416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b59c7-725d-448f-ad91-5cf1cc84e6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.098372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b59c7-725d-448f-ad91-5cf1cc84e6ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.099126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b59c7-725d-448f-ad91-5cf1cc84e6ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:58:19.099437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b59c7-725d-448f-ad91-5cf1cc84e6ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.101060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b59c7-725d-448f-ad91-5cf1cc84e6ef admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.122229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1166/2333] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:58:19.127118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03453f80-75f8-4e76-9a7d-6aa112b3d763 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.140082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03453f80-75f8-4e76-9a7d-6aa112b3d763 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.146622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edb156-09d4-4d67-8aa1-97c16dc88815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.147231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edb156-09d4-4d67-8aa1-97c16dc88815 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.147878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edb156-09d4-4d67-8aa1-97c16dc88815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.147878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edb156-09d4-4d67-8aa1-97c16dc88815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.148501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edb156-09d4-4d67-8aa1-97c16dc88815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.150446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edb156-09d4-4d67-8aa1-97c16dc88815 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.191250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b59c7-725d-448f-ad91-5cf1cc84e6ef admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.191463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1168/2334] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:58:19 2022] POST /identity/v3/projects => generated 409 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:19.205828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b59c7-725d-448f-ad91-5cf1cc84e6ef admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.212970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:19.281755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b2b9-925b-4c43-94db-7e243d04f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.283028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b2b9-925b-4c43-94db-7e243d04f22e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.283388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b2b9-925b-4c43-94db-7e243d04f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.283669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b2b9-925b-4c43-94db-7e243d04f22e admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.284618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721b2b9-925b-4c43-94db-7e243d04f22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.286571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721b2b9-925b-4c43-94db-7e243d04f22e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.309725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1167/2335] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:58:19 2022] POST /identity/v3/users => generated 305 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:58:19.316238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edb156-09d4-4d67-8aa1-97c16dc88815 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.328561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edb156-09d4-4d67-8aa1-97c16dc88815 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.334515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab2c9c-dded-4836-8dbb-4af137685496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.335175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab2c9c-dded-4836-8dbb-4af137685496 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.335478 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab2c9c-dded-4836-8dbb-4af137685496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.335779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab2c9c-dded-4836-8dbb-4af137685496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.336458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab2c9c-dded-4836-8dbb-4af137685496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.338071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab2c9c-dded-4836-8dbb-4af137685496 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.350787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1169/2336] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:19.354995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b2b9-925b-4c43-94db-7e243d04f22e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.364881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b2b9-925b-4c43-94db-7e243d04f22e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.370070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a99ba4-8d01-4bcc-99c6-34be73e7aa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.370679 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99ba4-8d01-4bcc-99c6-34be73e7aa76 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.370995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99ba4-8d01-4bcc-99c6-34be73e7aa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.371273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99ba4-8d01-4bcc-99c6-34be73e7aa76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.371972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a99ba4-8d01-4bcc-99c6-34be73e7aa76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.373564 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a99ba4-8d01-4bcc-99c6-34be73e7aa76 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.384552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1168/2337] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:19.388979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab2c9c-dded-4836-8dbb-4af137685496 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.399220 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab2c9c-dded-4836-8dbb-4af137685496 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.403934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93537990-fd48-4f89-95c1-c969d3be607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.404593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93537990-fd48-4f89-95c1-c969d3be607b admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.404874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93537990-fd48-4f89-95c1-c969d3be607b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.405150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93537990-fd48-4f89-95c1-c969d3be607b admin admin] PATH_INFO: `/v3/projects/eda6dfc2e8e443b19b21ee4131a7d541/users/391236d0670e4b8abcb7296bef231e49/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.421258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93537990-fd48-4f89-95c1-c969d3be607b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda6dfc2e8e443b19b21ee4131a7d541, user_id=391236d0670e4b8abcb7296bef231e49, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.424227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93537990-fd48-4f89-95c1-c969d3be607b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.440363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1170/2338] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:19 2022] PUT /identity/v3/projects/eda6dfc2e8e443b19b21ee4131a7d541/users/391236d0670e4b8abcb7296bef231e49/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:19.451315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b9b6e-544d-45c5-b69f-9ef6c94b48d0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.451734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b9b6e-544d-45c5-b69f-9ef6c94b48d0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.451883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b9b6e-544d-45c5-b69f-9ef6c94b48d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.483397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a75b9b6e-544d-45c5-b69f-9ef6c94b48d0 None None] MFA Rules not processed for user `391236d0670e4b8abcb7296bef231e49`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:19.484637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a75b9b6e-544d-45c5-b69f-9ef6c94b48d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:19.549778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1169/2339] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:19.556011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93537990-fd48-4f89-95c1-c969d3be607b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.617508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93537990-fd48-4f89-95c1-c969d3be607b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.622129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a74a1-24a5-4cfe-add7-71914d0b1930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.622744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a74a1-24a5-4cfe-add7-71914d0b1930 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.623064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a74a1-24a5-4cfe-add7-71914d0b1930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.623341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a74a1-24a5-4cfe-add7-71914d0b1930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.624001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a74a1-24a5-4cfe-add7-71914d0b1930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.625963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a74a1-24a5-4cfe-add7-71914d0b1930 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.651762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1171/2340] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:58:19 2022] POST /identity/v3/projects => generated 407 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:19.655947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b9b6e-544d-45c5-b69f-9ef6c94b48d0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.667227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b9b6e-544d-45c5-b69f-9ef6c94b48d0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.723903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7955fdf-2039-4ca5-afa3-c2da5bb6e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.724523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7955fdf-2039-4ca5-afa3-c2da5bb6e973 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.724803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7955fdf-2039-4ca5-afa3-c2da5bb6e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.725075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7955fdf-2039-4ca5-afa3-c2da5bb6e973 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.725748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7955fdf-2039-4ca5-afa3-c2da5bb6e973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.728288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7955fdf-2039-4ca5-afa3-c2da5bb6e973 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.751264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1170/2341] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:58:19 2022] POST /identity/v3/users => generated 310 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:58:19.754759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a74a1-24a5-4cfe-add7-71914d0b1930 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.765192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a74a1-24a5-4cfe-add7-71914d0b1930 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.769946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20339595-50cc-45e2-876e-3f145dc5c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.770552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339595-50cc-45e2-876e-3f145dc5c6fc admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.770832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339595-50cc-45e2-876e-3f145dc5c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.771163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339595-50cc-45e2-876e-3f145dc5c6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.771854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20339595-50cc-45e2-876e-3f145dc5c6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.773940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20339595-50cc-45e2-876e-3f145dc5c6fc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.785276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1172/2342] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:19.790065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7955fdf-2039-4ca5-afa3-c2da5bb6e973 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.800213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7955fdf-2039-4ca5-afa3-c2da5bb6e973 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.804947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45611-1b0c-4980-bcf2-ed2903f52207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.805633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45611-1b0c-4980-bcf2-ed2903f52207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.805908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45611-1b0c-4980-bcf2-ed2903f52207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.806184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45611-1b0c-4980-bcf2-ed2903f52207 admin admin] PATH_INFO: `/v3/projects/538df5f6fa1e4316bcc2811a4ecfd9e8/users/f25c233d5bc54abfb6add9030c6220a7/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.808644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:19.824232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc45611-1b0c-4980-bcf2-ed2903f52207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538df5f6fa1e4316bcc2811a4ecfd9e8, user_id=f25c233d5bc54abfb6add9030c6220a7, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.826902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc45611-1b0c-4980-bcf2-ed2903f52207 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.841476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1171/2343] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:19 2022] PUT /identity/v3/projects/538df5f6fa1e4316bcc2811a4ecfd9e8/users/f25c233d5bc54abfb6add9030c6220a7/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:19.845537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20339595-50cc-45e2-876e-3f145dc5c6fc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.857314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20339595-50cc-45e2-876e-3f145dc5c6fc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.880187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:19.940315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb014f67-ee24-45b9-a869-668ce0130562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.940971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014f67-ee24-45b9-a869-668ce0130562 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.941258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014f67-ee24-45b9-a869-668ce0130562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.941589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014f67-ee24-45b9-a869-668ce0130562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.942309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb014f67-ee24-45b9-a869-668ce0130562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.943994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb014f67-ee24-45b9-a869-668ce0130562 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.954493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1173/2344] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:19.958722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45611-1b0c-4980-bcf2-ed2903f52207 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:19.969984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45611-1b0c-4980-bcf2-ed2903f52207 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:19.975160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48621e1c-4d4a-4148-8214-e5e0c0d28aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:19.975838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48621e1c-4d4a-4148-8214-e5e0c0d28aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:19.976790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48621e1c-4d4a-4148-8214-e5e0c0d28aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:19.977072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48621e1c-4d4a-4148-8214-e5e0c0d28aab admin admin] PATH_INFO: `/v3/projects/538df5f6fa1e4316bcc2811a4ecfd9e8/users/f25c233d5bc54abfb6add9030c6220a7/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:19.979272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48621e1c-4d4a-4148-8214-e5e0c0d28aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=538df5f6fa1e4316bcc2811a4ecfd9e8, user_id=f25c233d5bc54abfb6add9030c6220a7, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:19.981998 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48621e1c-4d4a-4148-8214-e5e0c0d28aab admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:19.993019 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1172/2345] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:19 2022] PUT /identity/v3/projects/538df5f6fa1e4316bcc2811a4ecfd9e8/users/f25c233d5bc54abfb6add9030c6220a7/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:20.005361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164250cf-2069-434e-92db-06c7f26794ce None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:20.005361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164250cf-2069-434e-92db-06c7f26794ce None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:20.005361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164250cf-2069-434e-92db-06c7f26794ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:20.034554 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-164250cf-2069-434e-92db-06c7f26794ce None None] MFA Rules not processed for user `f25c233d5bc54abfb6add9030c6220a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:20.035827 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-164250cf-2069-434e-92db-06c7f26794ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:20.130215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1174/2346] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:20 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:20.141171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48621e1c-4d4a-4148-8214-e5e0c0d28aab admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:20.142966 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-48621e1c-4d4a-4148-8214-e5e0c0d28aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:20.225593 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48621e1c-4d4a-4148-8214-e5e0c0d28aab admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:20.229942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76f8e-ee32-4479-b6f5-c32a93aa9492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:20.230565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76f8e-ee32-4479-b6f5-c32a93aa9492 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:20.230847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76f8e-ee32-4479-b6f5-c32a93aa9492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:20.231151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76f8e-ee32-4479-b6f5-c32a93aa9492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:20.240558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76f8e-ee32-4479-b6f5-c32a93aa9492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:20.242619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76f8e-ee32-4479-b6f5-c32a93aa9492 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:20.252906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1173/2347] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:20 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:20.434608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164250cf-2069-434e-92db-06c7f26794ce None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:20.445848 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164250cf-2069-434e-92db-06c7f26794ce None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:20.450132 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e7347-6cf3-49ec-9800-1995911a3358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:20.450306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e7347-6cf3-49ec-9800-1995911a3358 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:20.450499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e7347-6cf3-49ec-9800-1995911a3358 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:20.450774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e7347-6cf3-49ec-9800-1995911a3358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:20.511196 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e7347-6cf3-49ec-9800-1995911a3358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:20.512754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e7347-6cf3-49ec-9800-1995911a3358 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:20.522087 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1175/2348] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:21.855753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90feec-54bd-4a08-b20d-6de81955e21a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:21.856525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90feec-54bd-4a08-b20d-6de81955e21a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:21.856525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90feec-54bd-4a08-b20d-6de81955e21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:21.875574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7a90feec-54bd-4a08-b20d-6de81955e21a None None] MFA Rules not processed for user `df8fb928aa42413b9d03e83f46dd48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:21.877065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7a90feec-54bd-4a08-b20d-6de81955e21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:21.946809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1174/2349] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:30.056119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e7347-6cf3-49ec-9800-1995911a3358 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:30.104460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:30.123100 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e7347-6cf3-49ec-9800-1995911a3358 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:30.130667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:30.131961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:30.132463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:30.132974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] PATH_INFO: `/v3/users/391236d0670e4b8abcb7296bef231e49` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:30.134539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391236d0670e4b8abcb7296bef231e49)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:30.136545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:30.188300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391236d0670e4b8abcb7296bef231e49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.196017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391236d0670e4b8abcb7296bef231e49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.208972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391236d0670e4b8abcb7296bef231e49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.209627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391236d0670e4b8abcb7296bef231e49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.218791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391236d0670e4b8abcb7296bef231e49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.227271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1176/2350] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:30 2022] DELETE /identity/v3/users/391236d0670e4b8abcb7296bef231e49 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:30.233272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8aefd-20d0-4c19-b849-cc5c36ddb3fd None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:30.233784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8aefd-20d0-4c19-b849-cc5c36ddb3fd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:30.233903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8aefd-20d0-4c19-b849-cc5c36ddb3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:30.254237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-83c8aefd-20d0-4c19-b849-cc5c36ddb3fd None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:30.255661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-83c8aefd-20d0-4c19-b849-cc5c36ddb3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:30.309264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:30.319690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1175/2351] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:30.329534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:30.330981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:30.389699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f426d31-1d25-4a63-b47b-0eb4a1fc69c9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:30.393735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433ab0e-f88d-48ea-a491-c927b09cd8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:30.394382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433ab0e-f88d-48ea-a491-c927b09cd8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:30.394663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433ab0e-f88d-48ea-a491-c927b09cd8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:30.394966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433ab0e-f88d-48ea-a491-c927b09cd8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:30.404517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433ab0e-f88d-48ea-a491-c927b09cd8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:30.405957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433ab0e-f88d-48ea-a491-c927b09cd8a1 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:30.416003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1177/2352] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:30.695880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8aefd-20d0-4c19-b849-cc5c36ddb3fd None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:30.697730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-83c8aefd-20d0-4c19-b849-cc5c36ddb3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:30.709762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8aefd-20d0-4c19-b849-cc5c36ddb3fd None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:30.715668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:30.716338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:30.716620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:30.716896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] PATH_INFO: `/v3/projects/eda6dfc2e8e443b19b21ee4131a7d541` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:30.718084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda6dfc2e8e443b19b21ee4131a7d541)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:30.720060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:30.776127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda6dfc2e8e443b19b21ee4131a7d541', 'request_id': 'req-003df742-eeca-439a-bb98-1ec667a4bf65'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.783838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda6dfc2e8e443b19b21ee4131a7d541', 'request_id': 'req-003df742-eeca-439a-bb98-1ec667a4bf65'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.789864 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda6dfc2e8e443b19b21ee4131a7d541', 'request_id': 'req-003df742-eeca-439a-bb98-1ec667a4bf65'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.801839 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] The token cache is being invalidate because project eda6dfc2e8e443b19b21ee4131a7d541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:30.802148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.802980 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.804726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1176/2353] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:30 2022] DELETE /identity/v3/projects/eda6dfc2e8e443b19b21ee4131a7d541 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:30.808647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433ab0e-f88d-48ea-a491-c927b09cd8a1 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:30.819173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433ab0e-f88d-48ea-a491-c927b09cd8a1 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:30.885640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:30.886327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:30.886600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:30.886915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] PATH_INFO: `/v3/users/f25c233d5bc54abfb6add9030c6220a7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:30.888166 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25c233d5bc54abfb6add9030c6220a7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:30.890326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:30.897097 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:30.946616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25c233d5bc54abfb6add9030c6220a7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.954453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25c233d5bc54abfb6add9030c6220a7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.969516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25c233d5bc54abfb6add9030c6220a7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.970205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25c233d5bc54abfb6add9030c6220a7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.977773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70488d53-5d65-4a67-90df-77c0e621d63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25c233d5bc54abfb6add9030c6220a7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:30.983693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1178/2354] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:30 2022] DELETE /identity/v3/users/f25c233d5bc54abfb6add9030c6220a7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:58:31.261589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:31.263103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:31.276418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003df742-eeca-439a-bb98-1ec667a4bf65 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:31.337879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:31.338548 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.338825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.339129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] PATH_INFO: `/v3/projects/538df5f6fa1e4316bcc2811a4ecfd9e8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.340284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] RBAC: Authorizing `identity:delete_project(project_id=538df5f6fa1e4316bcc2811a4ecfd9e8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:31.342197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:31.389465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538df5f6fa1e4316bcc2811a4ecfd9e8', 'request_id': 'req-5655d2c5-8461-46a9-8fea-cebe0841470a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:31.396662 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538df5f6fa1e4316bcc2811a4ecfd9e8', 'request_id': 'req-5655d2c5-8461-46a9-8fea-cebe0841470a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:31.402498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538df5f6fa1e4316bcc2811a4ecfd9e8', 'request_id': 'req-5655d2c5-8461-46a9-8fea-cebe0841470a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:31.413809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] The token cache is being invalidate because project 538df5f6fa1e4316bcc2811a4ecfd9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:31.414093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:31.414719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5655d2c5-8461-46a9-8fea-cebe0841470a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:31.416261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1177/2355] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:31 2022] DELETE /identity/v3/projects/538df5f6fa1e4316bcc2811a4ecfd9e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:31.421610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2794-770f-4832-b5a1-fd882a31d6d0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.422136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2794-770f-4832-b5a1-fd882a31d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.422136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2794-770f-4832-b5a1-fd882a31d6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.441966 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6d6e2794-770f-4832-b5a1-fd882a31d6d0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:31.443236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6d6e2794-770f-4832-b5a1-fd882a31d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:31.503895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1179/2356] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:31.511652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70426-f188-45d3-8343-9741738e0127 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.511933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70426-f188-45d3-8343-9741738e0127 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.512200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70426-f188-45d3-8343-9741738e0127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.531456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0ab70426-f188-45d3-8343-9741738e0127 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:31.532576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0ab70426-f188-45d3-8343-9741738e0127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:31.540889 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1178/2357] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:31.545038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e2794-770f-4832-b5a1-fd882a31d6d0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:31.555739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e2794-770f-4832-b5a1-fd882a31d6d0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:31.562620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e20f83-d3f4-4c2b-b7d7-ed65f541e7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:31.565544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e20f83-d3f4-4c2b-b7d7-ed65f541e7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.565826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e20f83-d3f4-4c2b-b7d7-ed65f541e7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.566103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e20f83-d3f4-4c2b-b7d7-ed65f541e7b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.566821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e20f83-d3f4-4c2b-b7d7-ed65f541e7b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:58:31.567155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e20f83-d3f4-4c2b-b7d7-ed65f541e7b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:31.568822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e20f83-d3f4-4c2b-b7d7-ed65f541e7b9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:31.584588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1180/2358] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:58:31.589142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70426-f188-45d3-8343-9741738e0127 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:31.595685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:31.600001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70426-f188-45d3-8343-9741738e0127 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:31.606406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585376c-cec9-4dcd-9897-a8f4e99d062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:31.607172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585376c-cec9-4dcd-9897-a8f4e99d062d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.607648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585376c-cec9-4dcd-9897-a8f4e99d062d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.608103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585376c-cec9-4dcd-9897-a8f4e99d062d admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.608964 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585376c-cec9-4dcd-9897-a8f4e99d062d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:31.610905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585376c-cec9-4dcd-9897-a8f4e99d062d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:31.639449 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1179/2359] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:58:31 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:31.644289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e20f83-d3f4-4c2b-b7d7-ed65f541e7b9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:31.654443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e20f83-d3f4-4c2b-b7d7-ed65f541e7b9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:31.711103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ac0ab-fd1f-4341-b7eb-598c0cc6886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:31.711262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac0ab-fd1f-4341-b7eb-598c0cc6886d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.711545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac0ab-fd1f-4341-b7eb-598c0cc6886d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.711811 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac0ab-fd1f-4341-b7eb-598c0cc6886d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.712489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ac0ab-fd1f-4341-b7eb-598c0cc6886d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:31.714424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ac0ab-fd1f-4341-b7eb-598c0cc6886d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:31.736343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1181/2360] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:58:31 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:31.740463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585376c-cec9-4dcd-9897-a8f4e99d062d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:31.751025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585376c-cec9-4dcd-9897-a8f4e99d062d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:31.755677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cdc2f-9ff8-4aba-ac17-b8a2501d8141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:31.756282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cdc2f-9ff8-4aba-ac17-b8a2501d8141 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.756555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cdc2f-9ff8-4aba-ac17-b8a2501d8141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.756820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cdc2f-9ff8-4aba-ac17-b8a2501d8141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.757510 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cdc2f-9ff8-4aba-ac17-b8a2501d8141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:31.759124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cdc2f-9ff8-4aba-ac17-b8a2501d8141 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:31.768951 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1180/2361] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:31.773763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ac0ab-fd1f-4341-b7eb-598c0cc6886d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:31.779108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:31.785353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ac0ab-fd1f-4341-b7eb-598c0cc6886d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:31.791295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d678e6-e005-4fc1-9160-0c54a53f9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:31.791907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d678e6-e005-4fc1-9160-0c54a53f9ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.792182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d678e6-e005-4fc1-9160-0c54a53f9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.792451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d678e6-e005-4fc1-9160-0c54a53f9ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.793142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d678e6-e005-4fc1-9160-0c54a53f9ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:31.794740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d678e6-e005-4fc1-9160-0c54a53f9ad3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:31.805680 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1182/2362] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:31.809824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cdc2f-9ff8-4aba-ac17-b8a2501d8141 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:31.819785 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cdc2f-9ff8-4aba-ac17-b8a2501d8141 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:31.824440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910cb0c-bcb2-496e-88a4-00484f14caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:31.825093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910cb0c-bcb2-496e-88a4-00484f14caf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.825377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910cb0c-bcb2-496e-88a4-00484f14caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.825651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910cb0c-bcb2-496e-88a4-00484f14caf1 admin admin] PATH_INFO: `/v3/projects/0dbaadf8bef94a4ba91da463cb86a48d/users/42c4f375c37f4ec6bf3c5fa1d3681f33/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.840626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910cb0c-bcb2-496e-88a4-00484f14caf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbaadf8bef94a4ba91da463cb86a48d, user_id=42c4f375c37f4ec6bf3c5fa1d3681f33, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:31.843322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910cb0c-bcb2-496e-88a4-00484f14caf1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:31.856809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1181/2363] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:31 2022] PUT /identity/v3/projects/0dbaadf8bef94a4ba91da463cb86a48d/users/42c4f375c37f4ec6bf3c5fa1d3681f33/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:31.867068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00342-3a4e-4010-8866-ed6aa327c235 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:31.867448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00342-3a4e-4010-8866-ed6aa327c235 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:31.868203 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00342-3a4e-4010-8866-ed6aa327c235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:31.899026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3ed00342-3a4e-4010-8866-ed6aa327c235 None None] MFA Rules not processed for user `42c4f375c37f4ec6bf3c5fa1d3681f33`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:31.900324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3ed00342-3a4e-4010-8866-ed6aa327c235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:31.970252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1183/2364] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:31.974645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910cb0c-bcb2-496e-88a4-00484f14caf1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.041708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910cb0c-bcb2-496e-88a4-00484f14caf1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.047794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883e21f-63ae-401e-b56f-0d8799e1aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.048056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883e21f-63ae-401e-b56f-0d8799e1aa1b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.048346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883e21f-63ae-401e-b56f-0d8799e1aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.048618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883e21f-63ae-401e-b56f-0d8799e1aa1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.049317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883e21f-63ae-401e-b56f-0d8799e1aa1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.051447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883e21f-63ae-401e-b56f-0d8799e1aa1b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.092303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1182/2365] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:58:31 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:32.093598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00342-3a4e-4010-8866-ed6aa327c235 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.105754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00342-3a4e-4010-8866-ed6aa327c235 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.167441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fff45c-3279-41af-90eb-2456200c5272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.168068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fff45c-3279-41af-90eb-2456200c5272 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.168353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fff45c-3279-41af-90eb-2456200c5272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.168630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fff45c-3279-41af-90eb-2456200c5272 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.169298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fff45c-3279-41af-90eb-2456200c5272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.171289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fff45c-3279-41af-90eb-2456200c5272 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.191208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1184/2366] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:58:32 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:32.195750 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883e21f-63ae-401e-b56f-0d8799e1aa1b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.206063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883e21f-63ae-401e-b56f-0d8799e1aa1b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.211576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419887b-c0e4-4b79-8f3e-7a0b14cb01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.212200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419887b-c0e4-4b79-8f3e-7a0b14cb01d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.212480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419887b-c0e4-4b79-8f3e-7a0b14cb01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.212754 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419887b-c0e4-4b79-8f3e-7a0b14cb01d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.213460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419887b-c0e4-4b79-8f3e-7a0b14cb01d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.215106 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419887b-c0e4-4b79-8f3e-7a0b14cb01d7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.225909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1183/2367] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:32.231745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fff45c-3279-41af-90eb-2456200c5272 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.242323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fff45c-3279-41af-90eb-2456200c5272 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.248071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edcf1b-b357-467e-8ce3-26fa5fdf3160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.248816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edcf1b-b357-467e-8ce3-26fa5fdf3160 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.249082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edcf1b-b357-467e-8ce3-26fa5fdf3160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.249351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edcf1b-b357-467e-8ce3-26fa5fdf3160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.250095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edcf1b-b357-467e-8ce3-26fa5fdf3160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.251705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edcf1b-b357-467e-8ce3-26fa5fdf3160 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.266230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1185/2368] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:32.270723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419887b-c0e4-4b79-8f3e-7a0b14cb01d7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.282429 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419887b-c0e4-4b79-8f3e-7a0b14cb01d7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.287263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f40d6-a461-4381-95d6-2d0c3e845fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.287933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f40d6-a461-4381-95d6-2d0c3e845fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.288258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f40d6-a461-4381-95d6-2d0c3e845fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.288526 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f40d6-a461-4381-95d6-2d0c3e845fa2 admin admin] PATH_INFO: `/v3/projects/633e3551237a4a9987f07ffd7e69d4b1/users/a1c11ee10cd74657a399780674673eac/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.304203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f40d6-a461-4381-95d6-2d0c3e845fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633e3551237a4a9987f07ffd7e69d4b1, user_id=a1c11ee10cd74657a399780674673eac, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.306773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f40d6-a461-4381-95d6-2d0c3e845fa2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.320435 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1184/2369] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:32 2022] PUT /identity/v3/projects/633e3551237a4a9987f07ffd7e69d4b1/users/a1c11ee10cd74657a399780674673eac/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:32.387446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945bbc-a575-4a36-83b8-97d397ef1d29 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.387732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945bbc-a575-4a36-83b8-97d397ef1d29 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.388030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945bbc-a575-4a36-83b8-97d397ef1d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.416789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-24945bbc-a575-4a36-83b8-97d397ef1d29 None None] MFA Rules not processed for user `a1c11ee10cd74657a399780674673eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:32.418003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-24945bbc-a575-4a36-83b8-97d397ef1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:32.465910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:32.485033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1186/2370] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:32.491856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f40d6-a461-4381-95d6-2d0c3e845fa2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.554160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:32.558308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f40d6-a461-4381-95d6-2d0c3e845fa2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.564338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fac7e-86b3-4e47-bcd7-9324262392c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.564962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fac7e-86b3-4e47-bcd7-9324262392c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.565245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fac7e-86b3-4e47-bcd7-9324262392c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.565519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fac7e-86b3-4e47-bcd7-9324262392c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.566199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fac7e-86b3-4e47-bcd7-9324262392c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.568181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fac7e-86b3-4e47-bcd7-9324262392c4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.596514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1185/2371] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:58:32 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:32.599335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24945bbc-a575-4a36-83b8-97d397ef1d29 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.610249 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24945bbc-a575-4a36-83b8-97d397ef1d29 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.667447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc031e-6377-4213-bb88-3c965a315213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.668064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc031e-6377-4213-bb88-3c965a315213 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.668347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc031e-6377-4213-bb88-3c965a315213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.668625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc031e-6377-4213-bb88-3c965a315213 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.669287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc031e-6377-4213-bb88-3c965a315213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.671251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc031e-6377-4213-bb88-3c965a315213 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.693234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1187/2372] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:58:32 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:32.697852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fac7e-86b3-4e47-bcd7-9324262392c4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.708557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fac7e-86b3-4e47-bcd7-9324262392c4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.713311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80127-bfe8-4a5b-91cd-93e10c5acc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.713926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80127-bfe8-4a5b-91cd-93e10c5acc01 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.714206 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80127-bfe8-4a5b-91cd-93e10c5acc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.714482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80127-bfe8-4a5b-91cd-93e10c5acc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.715225 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de80127-bfe8-4a5b-91cd-93e10c5acc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.717203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de80127-bfe8-4a5b-91cd-93e10c5acc01 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.728062 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1186/2373] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:32.732344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc031e-6377-4213-bb88-3c965a315213 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.742756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc031e-6377-4213-bb88-3c965a315213 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.747703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d56070-ab6e-4a35-b6d1-c92381c9c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.748473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d56070-ab6e-4a35-b6d1-c92381c9c14e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.748782 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d56070-ab6e-4a35-b6d1-c92381c9c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.749061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d56070-ab6e-4a35-b6d1-c92381c9c14e admin admin] PATH_INFO: `/v3/projects/01593668a3a247d1949b1e6589cdea10/users/899be3b343b64d53876abf1023daa75d/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.764911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d56070-ab6e-4a35-b6d1-c92381c9c14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=01593668a3a247d1949b1e6589cdea10, user_id=899be3b343b64d53876abf1023daa75d, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.767762 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d56070-ab6e-4a35-b6d1-c92381c9c14e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.780446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1188/2374] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:32 2022] PUT /identity/v3/projects/01593668a3a247d1949b1e6589cdea10/users/899be3b343b64d53876abf1023daa75d/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:58:32.784559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80127-bfe8-4a5b-91cd-93e10c5acc01 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.794543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80127-bfe8-4a5b-91cd-93e10c5acc01 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.850324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ced3a-769d-44a5-840b-34670f61537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.851477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ced3a-769d-44a5-840b-34670f61537b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.851758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ced3a-769d-44a5-840b-34670f61537b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.852030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ced3a-769d-44a5-840b-34670f61537b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.852734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ced3a-769d-44a5-840b-34670f61537b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.854333 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ced3a-769d-44a5-840b-34670f61537b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.864172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1187/2375] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:32.869103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d56070-ab6e-4a35-b6d1-c92381c9c14e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:32.880430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d56070-ab6e-4a35-b6d1-c92381c9c14e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:32.885276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f540e-6b11-4046-9209-f42476d0070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:32.885949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f540e-6b11-4046-9209-f42476d0070f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.886232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f540e-6b11-4046-9209-f42476d0070f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.886505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f540e-6b11-4046-9209-f42476d0070f admin admin] PATH_INFO: `/v3/projects/01593668a3a247d1949b1e6589cdea10/users/899be3b343b64d53876abf1023daa75d/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.888506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f540e-6b11-4046-9209-f42476d0070f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01593668a3a247d1949b1e6589cdea10, user_id=899be3b343b64d53876abf1023daa75d, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:32.891212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f540e-6b11-4046-9209-f42476d0070f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:32.901687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1189/2376] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:32 2022] PUT /identity/v3/projects/01593668a3a247d1949b1e6589cdea10/users/899be3b343b64d53876abf1023daa75d/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:32.911793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721948db-5fd4-4b67-8660-ae094377e44a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:32.912093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721948db-5fd4-4b67-8660-ae094377e44a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:32.912368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721948db-5fd4-4b67-8660-ae094377e44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:32.940749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-721948db-5fd4-4b67-8660-ae094377e44a None None] MFA Rules not processed for user `899be3b343b64d53876abf1023daa75d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:32.941970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-721948db-5fd4-4b67-8660-ae094377e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:33.014728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1188/2377] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:33.026021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f540e-6b11-4046-9209-f42476d0070f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:33.027734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d8f540e-6b11-4046-9209-f42476d0070f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:33.086670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f540e-6b11-4046-9209-f42476d0070f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:33.090281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289094a-c1d6-4c7a-9697-a662db990afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:33.090923 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289094a-c1d6-4c7a-9697-a662db990afd service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:33.091211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289094a-c1d6-4c7a-9697-a662db990afd service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:33.091491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289094a-c1d6-4c7a-9697-a662db990afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:33.103120 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289094a-c1d6-4c7a-9697-a662db990afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:33.104841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289094a-c1d6-4c7a-9697-a662db990afd service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:33.114658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1190/2378] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:33.157825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721948db-5fd4-4b67-8660-ae094377e44a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:33.159317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-721948db-5fd4-4b67-8660-ae094377e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:33.172626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721948db-5fd4-4b67-8660-ae094377e44a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:33.176677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d79da-c34b-4662-bf8a-af8669ad6d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:33.177304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d79da-c34b-4662-bf8a-af8669ad6d58 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:33.177870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d79da-c34b-4662-bf8a-af8669ad6d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:33.178153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d79da-c34b-4662-bf8a-af8669ad6d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:33.236453 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:33.248776 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d79da-c34b-4662-bf8a-af8669ad6d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:33.250269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d79da-c34b-4662-bf8a-af8669ad6d58 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:33.260198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1189/2379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:36.165783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289094a-c1d6-4c7a-9697-a662db990afd service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:36.217818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:36.237656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289094a-c1d6-4c7a-9697-a662db990afd service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:36.242522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:36.243288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:36.243707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:36.244014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] PATH_INFO: `/v3/users/42c4f375c37f4ec6bf3c5fa1d3681f33` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:36.245280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c4f375c37f4ec6bf3c5fa1d3681f33)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:36.247728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:36.303578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c4f375c37f4ec6bf3c5fa1d3681f33'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:36.315165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c4f375c37f4ec6bf3c5fa1d3681f33'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:36.333953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c4f375c37f4ec6bf3c5fa1d3681f33'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:36.335429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c4f375c37f4ec6bf3c5fa1d3681f33'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:36.343861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c4f375c37f4ec6bf3c5fa1d3681f33'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:36.351577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1191/2380] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:36 2022] DELETE /identity/v3/users/42c4f375c37f4ec6bf3c5fa1d3681f33 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:36.357233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fbec0-8c58-495e-8cdd-6f0318c1fcb3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:36.357837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fbec0-8c58-495e-8cdd-6f0318c1fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:36.357837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fbec0-8c58-495e-8cdd-6f0318c1fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:36.377044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1a1fbec0-8c58-495e-8cdd-6f0318c1fcb3 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:36.378291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1a1fbec0-8c58-495e-8cdd-6f0318c1fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:36.460628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1190/2381] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:58:36.466398 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:36.468564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:36.529180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbffab-c2aa-4bb6-b67b-22f2cfa3c057 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:36.532886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59184753-aa40-42de-b358-76cc72cbef7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:36.533495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59184753-aa40-42de-b358-76cc72cbef7d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:36.533769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59184753-aa40-42de-b358-76cc72cbef7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:36.534047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59184753-aa40-42de-b358-76cc72cbef7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:36.544021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59184753-aa40-42de-b358-76cc72cbef7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:36.545492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59184753-aa40-42de-b358-76cc72cbef7d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:36.555091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1192/2382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:58:36.908443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fbec0-8c58-495e-8cdd-6f0318c1fcb3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:36.909991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1a1fbec0-8c58-495e-8cdd-6f0318c1fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:36.924084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fbec0-8c58-495e-8cdd-6f0318c1fcb3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:36.928874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:36.929519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:36.929802 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:36.930080 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] PATH_INFO: `/v3/projects/0dbaadf8bef94a4ba91da463cb86a48d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:36.931308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbaadf8bef94a4ba91da463cb86a48d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:36.933242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:36.996471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbaadf8bef94a4ba91da463cb86a48d', 'request_id': 'req-f0b81be3-599b-4a23-922e-2c790bb31450'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.005433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbaadf8bef94a4ba91da463cb86a48d', 'request_id': 'req-f0b81be3-599b-4a23-922e-2c790bb31450'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.011697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbaadf8bef94a4ba91da463cb86a48d', 'request_id': 'req-f0b81be3-599b-4a23-922e-2c790bb31450'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.023394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] The token cache is being invalidate because project 0dbaadf8bef94a4ba91da463cb86a48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:37.023678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.024303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.025798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1191/2383] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:36 2022] DELETE /identity/v3/projects/0dbaadf8bef94a4ba91da463cb86a48d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:37.029757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59184753-aa40-42de-b358-76cc72cbef7d service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:37.039491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59184753-aa40-42de-b358-76cc72cbef7d service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:37.099989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:37.100625 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:37.100900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:37.101165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] PATH_INFO: `/v3/users/a1c11ee10cd74657a399780674673eac` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:37.102309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c11ee10cd74657a399780674673eac)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:37.104261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:37.109572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:37.150019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c11ee10cd74657a399780674673eac'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.157031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c11ee10cd74657a399780674673eac'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.169181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c11ee10cd74657a399780674673eac'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.169863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c11ee10cd74657a399780674673eac'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.177462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c11ee10cd74657a399780674673eac'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.183888 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1193/2384] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:37 2022] DELETE /identity/v3/users/a1c11ee10cd74657a399780674673eac => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:37.463938 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:37.465455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:37.480107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b81be3-599b-4a23-922e-2c790bb31450 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:37.536977 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:37.537632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:37.538417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:37.538699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] PATH_INFO: `/v3/projects/633e3551237a4a9987f07ffd7e69d4b1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:37.539977 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=633e3551237a4a9987f07ffd7e69d4b1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:37.541892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:37.559621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:37.589410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633e3551237a4a9987f07ffd7e69d4b1', 'request_id': 'req-894ed97b-c243-4dbb-bae5-30c394668f2c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.597113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633e3551237a4a9987f07ffd7e69d4b1', 'request_id': 'req-894ed97b-c243-4dbb-bae5-30c394668f2c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.603269 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633e3551237a4a9987f07ffd7e69d4b1', 'request_id': 'req-894ed97b-c243-4dbb-bae5-30c394668f2c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.614318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] The token cache is being invalidate because project 633e3551237a4a9987f07ffd7e69d4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:37.614606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.615277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.617719 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1192/2385] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:37 2022] DELETE /identity/v3/projects/633e3551237a4a9987f07ffd7e69d4b1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:37.621484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:37.622958 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:37.635860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79ad2e-c0b2-4079-80e0-467ea2395c95 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:37.692451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:37.693014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:37.693296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:37.693595 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] PATH_INFO: `/v3/users/899be3b343b64d53876abf1023daa75d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:37.694763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=899be3b343b64d53876abf1023daa75d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:37.696731 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:37.742118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899be3b343b64d53876abf1023daa75d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.749861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899be3b343b64d53876abf1023daa75d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.762199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899be3b343b64d53876abf1023daa75d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.762853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899be3b343b64d53876abf1023daa75d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.769623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecc203f4-360c-4979-815d-f580035a90fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899be3b343b64d53876abf1023daa75d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:37.776016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1194/2386] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:37 2022] DELETE /identity/v3/users/899be3b343b64d53876abf1023daa75d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:38.105560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:38.107035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:38.119644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ed97b-c243-4dbb-bae5-30c394668f2c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:38.187832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:38.188489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.188774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.189047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] PATH_INFO: `/v3/projects/01593668a3a247d1949b1e6589cdea10` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.190219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01593668a3a247d1949b1e6589cdea10)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:38.192164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:38.237620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01593668a3a247d1949b1e6589cdea10', 'request_id': 'req-90f2314d-5c33-46f3-9288-06bb9252a80c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:38.244160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01593668a3a247d1949b1e6589cdea10', 'request_id': 'req-90f2314d-5c33-46f3-9288-06bb9252a80c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:38.250465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01593668a3a247d1949b1e6589cdea10', 'request_id': 'req-90f2314d-5c33-46f3-9288-06bb9252a80c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:38.262463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] The token cache is being invalidate because project 01593668a3a247d1949b1e6589cdea10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:38.262751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:38.263485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90f2314d-5c33-46f3-9288-06bb9252a80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:38.265170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1193/2387] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:38 2022] DELETE /identity/v3/projects/01593668a3a247d1949b1e6589cdea10 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:58:38.274663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1402d-bfe8-4f8a-a1b9-9328516d321a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.275200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1402d-bfe8-4f8a-a1b9-9328516d321a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.275292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1402d-bfe8-4f8a-a1b9-9328516d321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.284989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:38.298024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-66e1402d-bfe8-4f8a-a1b9-9328516d321a None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:38.299644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-66e1402d-bfe8-4f8a-a1b9-9328516d321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:38.363725 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1195/2388] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:58:38.373583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c9801-cc97-451b-b9e3-b8effb1c90c5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.373873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c9801-cc97-451b-b9e3-b8effb1c90c5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.374150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c9801-cc97-451b-b9e3-b8effb1c90c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.395040 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c13c9801-cc97-451b-b9e3-b8effb1c90c5 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:38.396283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c13c9801-cc97-451b-b9e3-b8effb1c90c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:38.405382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1194/2389] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:38.409628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1402d-bfe8-4f8a-a1b9-9328516d321a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:38.424764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1402d-bfe8-4f8a-a1b9-9328516d321a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:38.429948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987c011-ca0f-4b47-ab2d-eaaf6201d8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:38.430248 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987c011-ca0f-4b47-ab2d-eaaf6201d8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.430523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987c011-ca0f-4b47-ab2d-eaaf6201d8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.430791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987c011-ca0f-4b47-ab2d-eaaf6201d8a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.431538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987c011-ca0f-4b47-ab2d-eaaf6201d8a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:58:38.431840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987c011-ca0f-4b47-ab2d-eaaf6201d8a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:38.433468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987c011-ca0f-4b47-ab2d-eaaf6201d8a6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:38.445860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1196/2390] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:58:38.450308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c9801-cc97-451b-b9e3-b8effb1c90c5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:38.460450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c9801-cc97-451b-b9e3-b8effb1c90c5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:38.465238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07552c3-9ed2-46ab-930c-28020424e005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:38.465869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07552c3-9ed2-46ab-930c-28020424e005 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.466130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07552c3-9ed2-46ab-930c-28020424e005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.466433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07552c3-9ed2-46ab-930c-28020424e005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.467160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07552c3-9ed2-46ab-930c-28020424e005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:38.469518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07552c3-9ed2-46ab-930c-28020424e005 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:38.515680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1195/2391] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:58:38 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:38.516765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987c011-ca0f-4b47-ab2d-eaaf6201d8a6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:38.528521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987c011-ca0f-4b47-ab2d-eaaf6201d8a6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:38.587045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88192fbf-3ebb-476f-b2b6-c139313a4733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:38.587673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88192fbf-3ebb-476f-b2b6-c139313a4733 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.587956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88192fbf-3ebb-476f-b2b6-c139313a4733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.588235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88192fbf-3ebb-476f-b2b6-c139313a4733 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.588921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88192fbf-3ebb-476f-b2b6-c139313a4733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:38.590921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88192fbf-3ebb-476f-b2b6-c139313a4733 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:38.612879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1197/2392] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:58:38 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:38.617430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07552c3-9ed2-46ab-930c-28020424e005 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:38.628044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07552c3-9ed2-46ab-930c-28020424e005 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:38.633224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e5a0-058b-40fc-9aa3-d231b10f6043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:38.633829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e5a0-058b-40fc-9aa3-d231b10f6043 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.634103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e5a0-058b-40fc-9aa3-d231b10f6043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.634371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e5a0-058b-40fc-9aa3-d231b10f6043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.635098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e5a0-058b-40fc-9aa3-d231b10f6043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:38.636680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e5a0-058b-40fc-9aa3-d231b10f6043 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:38.637953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:38.649159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1196/2393] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:38.653168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88192fbf-3ebb-476f-b2b6-c139313a4733 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:38.663605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88192fbf-3ebb-476f-b2b6-c139313a4733 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:38.668399 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0be11d-4c40-4e86-adc4-432c90620fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:38.669029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0be11d-4c40-4e86-adc4-432c90620fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.669309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0be11d-4c40-4e86-adc4-432c90620fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.669583 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0be11d-4c40-4e86-adc4-432c90620fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.670280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0be11d-4c40-4e86-adc4-432c90620fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:38.671950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0be11d-4c40-4e86-adc4-432c90620fa1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:38.682999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1198/2394] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:38.687120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e5a0-058b-40fc-9aa3-d231b10f6043 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:38.697538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e5a0-058b-40fc-9aa3-d231b10f6043 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:38.702075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f0e4a-6f3c-47d1-9637-d0f104ea0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:38.702717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f0e4a-6f3c-47d1-9637-d0f104ea0f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.703030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f0e4a-6f3c-47d1-9637-d0f104ea0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.703300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f0e4a-6f3c-47d1-9637-d0f104ea0f06 admin admin] PATH_INFO: `/v3/projects/042beec9d1c4433ca45916849a1347fd/users/347f3453403843f3ae441a919862d8d7/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.717529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f0e4a-6f3c-47d1-9637-d0f104ea0f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042beec9d1c4433ca45916849a1347fd, user_id=347f3453403843f3ae441a919862d8d7, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:38.720211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f0e4a-6f3c-47d1-9637-d0f104ea0f06 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:38.733710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1197/2395] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:38 2022] PUT /identity/v3/projects/042beec9d1c4433ca45916849a1347fd/users/347f3453403843f3ae441a919862d8d7/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:38.745281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48744c-c13d-4421-9641-f8b41adc97a7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.745643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48744c-c13d-4421-9641-f8b41adc97a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.745920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48744c-c13d-4421-9641-f8b41adc97a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.773946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ff48744c-c13d-4421-9641-f8b41adc97a7 None None] MFA Rules not processed for user `347f3453403843f3ae441a919862d8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:38.775147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ff48744c-c13d-4421-9641-f8b41adc97a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:38.838700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:38.843829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1199/2396] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:38.848823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f0e4a-6f3c-47d1-9637-d0f104ea0f06 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:38.910182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f0e4a-6f3c-47d1-9637-d0f104ea0f06 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:38.915446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893129-305a-4916-8a0c-1509abd26455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:38.916071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893129-305a-4916-8a0c-1509abd26455 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:38.916354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893129-305a-4916-8a0c-1509abd26455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:38.916630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893129-305a-4916-8a0c-1509abd26455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:38.917299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88893129-305a-4916-8a0c-1509abd26455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:38.919252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88893129-305a-4916-8a0c-1509abd26455 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:38.946249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1198/2397] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:58:38 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:38.950454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48744c-c13d-4421-9641-f8b41adc97a7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:38.971556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48744c-c13d-4421-9641-f8b41adc97a7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:39.043757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e55b8a-78a3-4b62-aa8f-2d323cc3a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:39.044512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e55b8a-78a3-4b62-aa8f-2d323cc3a709 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:39.044895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e55b8a-78a3-4b62-aa8f-2d323cc3a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:39.045268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e55b8a-78a3-4b62-aa8f-2d323cc3a709 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:39.046080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e55b8a-78a3-4b62-aa8f-2d323cc3a709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:39.048305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e55b8a-78a3-4b62-aa8f-2d323cc3a709 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:39.075732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1200/2398] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:58:38 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:58:39.076338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893129-305a-4916-8a0c-1509abd26455 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:39.089151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893129-305a-4916-8a0c-1509abd26455 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:39.094414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cdcaf-ca76-4d20-b0c7-2f4d90dec676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:39.095368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cdcaf-ca76-4d20-b0c7-2f4d90dec676 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:39.095684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cdcaf-ca76-4d20-b0c7-2f4d90dec676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:39.096053 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cdcaf-ca76-4d20-b0c7-2f4d90dec676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:39.097110 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cdcaf-ca76-4d20-b0c7-2f4d90dec676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:39.098854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cdcaf-ca76-4d20-b0c7-2f4d90dec676 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:39.117554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1199/2399] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:39.118810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e55b8a-78a3-4b62-aa8f-2d323cc3a709 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:39.130248 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e55b8a-78a3-4b62-aa8f-2d323cc3a709 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:39.138065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f2aca-4a58-4cd4-b767-8b4b750fb26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:39.139090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f2aca-4a58-4cd4-b767-8b4b750fb26a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:39.140061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f2aca-4a58-4cd4-b767-8b4b750fb26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:39.140499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f2aca-4a58-4cd4-b767-8b4b750fb26a admin admin] PATH_INFO: `/v3/projects/6419722f051347bbabc04a9ed86bd79d/users/a606bf3c342e436c9e4b7e5f17bcfb5e/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:39.161789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f2aca-4a58-4cd4-b767-8b4b750fb26a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6419722f051347bbabc04a9ed86bd79d, user_id=a606bf3c342e436c9e4b7e5f17bcfb5e, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:39.165696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f2aca-4a58-4cd4-b767-8b4b750fb26a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:39.201981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1201/2400] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:39 2022] PUT /identity/v3/projects/6419722f051347bbabc04a9ed86bd79d/users/a606bf3c342e436c9e4b7e5f17bcfb5e/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:39.205848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cdcaf-ca76-4d20-b0c7-2f4d90dec676 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:39.218678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cdcaf-ca76-4d20-b0c7-2f4d90dec676 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:39.287260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161d8db-c4ee-45b5-8a31-00bd5804fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:39.288568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161d8db-c4ee-45b5-8a31-00bd5804fb82 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:39.288859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161d8db-c4ee-45b5-8a31-00bd5804fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:39.289212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161d8db-c4ee-45b5-8a31-00bd5804fb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:39.289837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161d8db-c4ee-45b5-8a31-00bd5804fb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:39.291479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161d8db-c4ee-45b5-8a31-00bd5804fb82 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:39.302465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1200/2401] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:39.306499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f2aca-4a58-4cd4-b767-8b4b750fb26a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:39.317493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f2aca-4a58-4cd4-b767-8b4b750fb26a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:39.322568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9af75-5565-4e88-8553-bd98a084ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:39.323269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9af75-5565-4e88-8553-bd98a084ea64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:39.323545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9af75-5565-4e88-8553-bd98a084ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:39.323815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9af75-5565-4e88-8553-bd98a084ea64 admin admin] PATH_INFO: `/v3/projects/6419722f051347bbabc04a9ed86bd79d/users/a606bf3c342e436c9e4b7e5f17bcfb5e/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:39.325744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9af75-5565-4e88-8553-bd98a084ea64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6419722f051347bbabc04a9ed86bd79d, user_id=a606bf3c342e436c9e4b7e5f17bcfb5e, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:39.328421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9af75-5565-4e88-8553-bd98a084ea64 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:39.340857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1202/2402] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:39 2022] PUT /identity/v3/projects/6419722f051347bbabc04a9ed86bd79d/users/a606bf3c342e436c9e4b7e5f17bcfb5e/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:39.352218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c2bb2-04cd-4b24-8079-3868a26b3989 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:39.352792 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c2bb2-04cd-4b24-8079-3868a26b3989 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:39.354238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c2bb2-04cd-4b24-8079-3868a26b3989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:39.386039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5e6c2bb2-04cd-4b24-8079-3868a26b3989 None None] MFA Rules not processed for user `a606bf3c342e436c9e4b7e5f17bcfb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:39.387301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5e6c2bb2-04cd-4b24-8079-3868a26b3989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:39.418193 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:39.458316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1201/2403] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:39.470586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9af75-5565-4e88-8553-bd98a084ea64 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:39.472570 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-26d9af75-5565-4e88-8553-bd98a084ea64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:39.532874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9af75-5565-4e88-8553-bd98a084ea64 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:39.536596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9b70-69ef-45ee-aa6c-8c3f029e5247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:39.537212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9b70-69ef-45ee-aa6c-8c3f029e5247 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:39.537554 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9b70-69ef-45ee-aa6c-8c3f029e5247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:39.538328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9b70-69ef-45ee-aa6c-8c3f029e5247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:39.548137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc9b70-69ef-45ee-aa6c-8c3f029e5247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:39.549950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc9b70-69ef-45ee-aa6c-8c3f029e5247 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:39.560306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1203/2404] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:39.659409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c2bb2-04cd-4b24-8079-3868a26b3989 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:39.669105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c2bb2-04cd-4b24-8079-3868a26b3989 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:39.672704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497825-f706-4a6f-a04d-0cbf99fa2c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:39.673310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497825-f706-4a6f-a04d-0cbf99fa2c7a service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:39.673584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497825-f706-4a6f-a04d-0cbf99fa2c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:39.673852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497825-f706-4a6f-a04d-0cbf99fa2c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:39.728387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8497825-f706-4a6f-a04d-0cbf99fa2c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:39.729805 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8497825-f706-4a6f-a04d-0cbf99fa2c7a service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:39.738825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1202/2405] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:40.023636 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9b70-69ef-45ee-aa6c-8c3f029e5247 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:40.079955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:40.087080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9b70-69ef-45ee-aa6c-8c3f029e5247 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:40.091794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:40.092461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:40.092743 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:40.093049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] PATH_INFO: `/v3/users/347f3453403843f3ae441a919862d8d7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:40.094230 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=347f3453403843f3ae441a919862d8d7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:40.096442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:40.142608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347f3453403843f3ae441a919862d8d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.149855 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347f3453403843f3ae441a919862d8d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.162237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347f3453403843f3ae441a919862d8d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.162908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347f3453403843f3ae441a919862d8d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.169695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347f3453403843f3ae441a919862d8d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.175935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1204/2406] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:40 2022] DELETE /identity/v3/users/347f3453403843f3ae441a919862d8d7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:40.180605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee682fd-6800-459a-bc25-b5480f4abf87 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:40.180888 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee682fd-6800-459a-bc25-b5480f4abf87 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:40.181157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee682fd-6800-459a-bc25-b5480f4abf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:40.200942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1ee682fd-6800-459a-bc25-b5480f4abf87 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:40.202227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1ee682fd-6800-459a-bc25-b5480f4abf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:40.267620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1203/2407] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:40.276987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:40.278513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:40.342456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426102e-f9ae-4231-8178-c4aa8ef6c967 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:40.346998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1247e04-2d5f-47f2-8085-29d2a138d497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:40.347687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1247e04-2d5f-47f2-8085-29d2a138d497 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:40.347971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1247e04-2d5f-47f2-8085-29d2a138d497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:40.348257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1247e04-2d5f-47f2-8085-29d2a138d497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:40.365879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1247e04-2d5f-47f2-8085-29d2a138d497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:40.365879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1247e04-2d5f-47f2-8085-29d2a138d497 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:40.373093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1205/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:40.802945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee682fd-6800-459a-bc25-b5480f4abf87 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:40.804459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1ee682fd-6800-459a-bc25-b5480f4abf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:40.817649 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee682fd-6800-459a-bc25-b5480f4abf87 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:40.822530 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:40.823216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:40.823501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:40.823777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] PATH_INFO: `/v3/projects/042beec9d1c4433ca45916849a1347fd` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:40.824958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] RBAC: Authorizing `identity:delete_project(project_id=042beec9d1c4433ca45916849a1347fd)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:40.826918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:40.888347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042beec9d1c4433ca45916849a1347fd', 'request_id': 'req-543bd90b-1c7d-47cc-8782-5e49b32c191f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.899700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042beec9d1c4433ca45916849a1347fd', 'request_id': 'req-543bd90b-1c7d-47cc-8782-5e49b32c191f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.904806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:40.908695 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042beec9d1c4433ca45916849a1347fd', 'request_id': 'req-543bd90b-1c7d-47cc-8782-5e49b32c191f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.924135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] The token cache is being invalidate because project 042beec9d1c4433ca45916849a1347fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:40.924420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.925139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:40.926841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1204/2409] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:40 2022] DELETE /identity/v3/projects/042beec9d1c4433ca45916849a1347fd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:40.931315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1247e04-2d5f-47f2-8085-29d2a138d497 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:40.943880 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1247e04-2d5f-47f2-8085-29d2a138d497 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:41.006027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:41.006718 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:41.007032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:41.007311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] PATH_INFO: `/v3/users/a606bf3c342e436c9e4b7e5f17bcfb5e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:41.011918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a606bf3c342e436c9e4b7e5f17bcfb5e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:41.013896 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:41.041513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:41.072946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a606bf3c342e436c9e4b7e5f17bcfb5e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:41.081192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a606bf3c342e436c9e4b7e5f17bcfb5e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:41.095950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a606bf3c342e436c9e4b7e5f17bcfb5e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:41.096876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a606bf3c342e436c9e4b7e5f17bcfb5e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:41.105310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22d66fec-7505-40f6-8535-5afaae36b397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a606bf3c342e436c9e4b7e5f17bcfb5e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:41.112245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1206/2410] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:40 2022] DELETE /identity/v3/users/a606bf3c342e436c9e4b7e5f17bcfb5e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:41.853993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:41.855543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:41.869070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bd90b-1c7d-47cc-8782-5e49b32c191f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:41.940472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:41.941129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:41.941407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:41.941681 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] PATH_INFO: `/v3/projects/6419722f051347bbabc04a9ed86bd79d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:41.942864 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6419722f051347bbabc04a9ed86bd79d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:41.945330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.008051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6419722f051347bbabc04a9ed86bd79d', 'request_id': 'req-e1323f5b-5c6e-4b33-83c9-c3167182b574'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:42.017563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6419722f051347bbabc04a9ed86bd79d', 'request_id': 'req-e1323f5b-5c6e-4b33-83c9-c3167182b574'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:42.026131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6419722f051347bbabc04a9ed86bd79d', 'request_id': 'req-e1323f5b-5c6e-4b33-83c9-c3167182b574'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:42.038296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] The token cache is being invalidate because project 6419722f051347bbabc04a9ed86bd79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:42.038579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:42.039514 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e1323f5b-5c6e-4b33-83c9-c3167182b574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:42.041029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1205/2411] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:41 2022] DELETE /identity/v3/projects/6419722f051347bbabc04a9ed86bd79d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:42.047042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2b3ba-b162-4419-a791-312c879de3df None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.047638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2b3ba-b162-4419-a791-312c879de3df None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.048330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2b3ba-b162-4419-a791-312c879de3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.069721 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-50c2b3ba-b162-4419-a791-312c879de3df None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:42.071205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-50c2b3ba-b162-4419-a791-312c879de3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:42.136576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1207/2412] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:42.147890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f8d1-8116-45ab-9060-ea22dcfea68f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.148127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f8d1-8116-45ab-9060-ea22dcfea68f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.148376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f8d1-8116-45ab-9060-ea22dcfea68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.170696 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2723f8d1-8116-45ab-9060-ea22dcfea68f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:42.171797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2723f8d1-8116-45ab-9060-ea22dcfea68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:42.181223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1206/2413] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:42.185358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2b3ba-b162-4419-a791-312c879de3df None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.196906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2b3ba-b162-4419-a791-312c879de3df None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.201670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faa8e9-fc82-4604-9de3-55dd57a888ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.202289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faa8e9-fc82-4604-9de3-55dd57a888ae admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.202700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faa8e9-fc82-4604-9de3-55dd57a888ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.203031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faa8e9-fc82-4604-9de3-55dd57a888ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.203735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faa8e9-fc82-4604-9de3-55dd57a888ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 07:58:42.204037 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faa8e9-fc82-4604-9de3-55dd57a888ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.205669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faa8e9-fc82-4604-9de3-55dd57a888ae admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.219992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1208/2414] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 07:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 07:58:42.224544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f8d1-8116-45ab-9060-ea22dcfea68f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.236492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f8d1-8116-45ab-9060-ea22dcfea68f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.243168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b8683-9872-4a84-b445-cfab548d513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.243958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b8683-9872-4a84-b445-cfab548d513f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.244252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b8683-9872-4a84-b445-cfab548d513f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.245107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b8683-9872-4a84-b445-cfab548d513f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.245228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b8683-9872-4a84-b445-cfab548d513f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.248483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b8683-9872-4a84-b445-cfab548d513f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.285756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1207/2415] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:58:42 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:42.291072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faa8e9-fc82-4604-9de3-55dd57a888ae admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.302384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faa8e9-fc82-4604-9de3-55dd57a888ae admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.368539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80f72e-530e-4089-887a-4853f56c9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.369300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80f72e-530e-4089-887a-4853f56c9dce admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.369642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80f72e-530e-4089-887a-4853f56c9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.369913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80f72e-530e-4089-887a-4853f56c9dce admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.370588 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80f72e-530e-4089-887a-4853f56c9dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.372618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80f72e-530e-4089-887a-4853f56c9dce admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.397657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1209/2416] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:58:42 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 07:58:42.399277 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b8683-9872-4a84-b445-cfab548d513f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.409352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b8683-9872-4a84-b445-cfab548d513f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.413974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d6d16-6fa8-4876-9f59-0cc29d9e0667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.414587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d6d16-6fa8-4876-9f59-0cc29d9e0667 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.414860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d6d16-6fa8-4876-9f59-0cc29d9e0667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.415166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d6d16-6fa8-4876-9f59-0cc29d9e0667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.415866 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d6d16-6fa8-4876-9f59-0cc29d9e0667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.417611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d6d16-6fa8-4876-9f59-0cc29d9e0667 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.433837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1208/2417] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:42.437939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80f72e-530e-4089-887a-4853f56c9dce admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.449092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80f72e-530e-4089-887a-4853f56c9dce admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.453830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991a5b3-af26-4a6d-bc31-55854c507851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.455254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a5b3-af26-4a6d-bc31-55854c507851 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.455538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a5b3-af26-4a6d-bc31-55854c507851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.455813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a5b3-af26-4a6d-bc31-55854c507851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.456522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991a5b3-af26-4a6d-bc31-55854c507851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.458149 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991a5b3-af26-4a6d-bc31-55854c507851 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.472403 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1210/2418] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:42.482991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d6d16-6fa8-4876-9f59-0cc29d9e0667 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.497161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d6d16-6fa8-4876-9f59-0cc29d9e0667 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.502604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61773b4e-9272-436d-a528-eedc427f6a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.503321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61773b4e-9272-436d-a528-eedc427f6a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.503598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61773b4e-9272-436d-a528-eedc427f6a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.503874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61773b4e-9272-436d-a528-eedc427f6a21 admin admin] PATH_INFO: `/v3/projects/15dceea7c3ec4ee0acbedb366399e295/users/bb89b43abb864fbba7ba813cc21e10e5/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.521521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61773b4e-9272-436d-a528-eedc427f6a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15dceea7c3ec4ee0acbedb366399e295, user_id=bb89b43abb864fbba7ba813cc21e10e5, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.524409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61773b4e-9272-436d-a528-eedc427f6a21 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.538390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1209/2419] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:42 2022] PUT /identity/v3/projects/15dceea7c3ec4ee0acbedb366399e295/users/bb89b43abb864fbba7ba813cc21e10e5/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:42.548668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126d89-e665-4169-862a-b0470ff6cfbe None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.548949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126d89-e665-4169-862a-b0470ff6cfbe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.549219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126d89-e665-4169-862a-b0470ff6cfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.557562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:42.581168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6b126d89-e665-4169-862a-b0470ff6cfbe None None] MFA Rules not processed for user `bb89b43abb864fbba7ba813cc21e10e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:42.582423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6b126d89-e665-4169-862a-b0470ff6cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:42.664334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1211/2420] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 07:58:42.668939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61773b4e-9272-436d-a528-eedc427f6a21 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.687824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:42.734760 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61773b4e-9272-436d-a528-eedc427f6a21 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.739854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9b774-dded-4170-9223-cbb94b7ce8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.740481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9b774-dded-4170-9223-cbb94b7ce8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.740803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9b774-dded-4170-9223-cbb94b7ce8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.741615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9b774-dded-4170-9223-cbb94b7ce8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.742290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9b774-dded-4170-9223-cbb94b7ce8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.744242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9b774-dded-4170-9223-cbb94b7ce8ff admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.772722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1210/2421] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 07:58:42 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:42.776897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b126d89-e665-4169-862a-b0470ff6cfbe None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.788584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b126d89-e665-4169-862a-b0470ff6cfbe None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.849445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399e658-abdd-4e87-921e-52f0443ca7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.850640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399e658-abdd-4e87-921e-52f0443ca7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.850959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399e658-abdd-4e87-921e-52f0443ca7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.851237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399e658-abdd-4e87-921e-52f0443ca7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.851946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399e658-abdd-4e87-921e-52f0443ca7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.854099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399e658-abdd-4e87-921e-52f0443ca7d0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.877428 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1212/2422] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 07:58:42 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 07:58:42.881947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9b774-dded-4170-9223-cbb94b7ce8ff admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.895790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9b774-dded-4170-9223-cbb94b7ce8ff admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.900749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9d215-dfb4-4e34-86c4-c7844fa8e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.901381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9d215-dfb4-4e34-86c4-c7844fa8e9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.901664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9d215-dfb4-4e34-86c4-c7844fa8e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.901936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9d215-dfb4-4e34-86c4-c7844fa8e9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.902644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9d215-dfb4-4e34-86c4-c7844fa8e9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.904336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9d215-dfb4-4e34-86c4-c7844fa8e9cf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.920620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1211/2423] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 07:58:42.922142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399e658-abdd-4e87-921e-52f0443ca7d0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:42.933935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399e658-abdd-4e87-921e-52f0443ca7d0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:42.939406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be676e4-988e-49a3-a652-476a3cf1e4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:42.940396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be676e4-988e-49a3-a652-476a3cf1e4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:42.940891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be676e4-988e-49a3-a652-476a3cf1e4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:42.941519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be676e4-988e-49a3-a652-476a3cf1e4eb admin admin] PATH_INFO: `/v3/projects/6aea3184378a4a478ed1097aca1b9341/users/a2ff36575b9348a08750bfba624f20dd/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:42.960553 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be676e4-988e-49a3-a652-476a3cf1e4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aea3184378a4a478ed1097aca1b9341, user_id=a2ff36575b9348a08750bfba624f20dd, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:42.964001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be676e4-988e-49a3-a652-476a3cf1e4eb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:42.986933 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1213/2424] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:42 2022] PUT /identity/v3/projects/6aea3184378a4a478ed1097aca1b9341/users/a2ff36575b9348a08750bfba624f20dd/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:42.996642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9d215-dfb4-4e34-86c4-c7844fa8e9cf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:43.019764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9d215-dfb4-4e34-86c4-c7844fa8e9cf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:43.095895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413a6d6-ea45-470d-b752-c584765f2ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:43.097090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413a6d6-ea45-470d-b752-c584765f2ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:43.097366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413a6d6-ea45-470d-b752-c584765f2ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:43.097675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413a6d6-ea45-470d-b752-c584765f2ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:43.098360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413a6d6-ea45-470d-b752-c584765f2ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:43.100143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413a6d6-ea45-470d-b752-c584765f2ec3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:43.119410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1212/2425] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 07:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 07:58:43.123517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be676e4-988e-49a3-a652-476a3cf1e4eb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:43.138091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be676e4-988e-49a3-a652-476a3cf1e4eb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:43.152499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bb580-cae8-4244-87ff-2aa4d8138748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:43.153364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bb580-cae8-4244-87ff-2aa4d8138748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:43.153653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bb580-cae8-4244-87ff-2aa4d8138748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:43.154103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bb580-cae8-4244-87ff-2aa4d8138748 admin admin] PATH_INFO: `/v3/projects/6aea3184378a4a478ed1097aca1b9341/users/a2ff36575b9348a08750bfba624f20dd/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:43.156374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bb580-cae8-4244-87ff-2aa4d8138748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aea3184378a4a478ed1097aca1b9341, user_id=a2ff36575b9348a08750bfba624f20dd, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:43.159253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bb580-cae8-4244-87ff-2aa4d8138748 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:43.179182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1214/2426] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 07:58:43 2022] PUT /identity/v3/projects/6aea3184378a4a478ed1097aca1b9341/users/a2ff36575b9348a08750bfba624f20dd/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:43.187910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f85c5-3d79-468d-be15-00866c3272f1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:43.188194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f85c5-3d79-468d-be15-00866c3272f1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:43.188470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f85c5-3d79-468d-be15-00866c3272f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:43.223444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-517f85c5-3d79-468d-be15-00866c3272f1 None None] MFA Rules not processed for user `a2ff36575b9348a08750bfba624f20dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:43.224714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-517f85c5-3d79-468d-be15-00866c3272f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:43.312002 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1213/2427] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:43.319536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bb580-cae8-4244-87ff-2aa4d8138748 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:43.321379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f61bb580-cae8-4244-87ff-2aa4d8138748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:43.379108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:43.393385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bb580-cae8-4244-87ff-2aa4d8138748 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:43.398322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55099b7-0ddf-4ef8-8f9d-fbb02bc6fc26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:43.398996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55099b7-0ddf-4ef8-8f9d-fbb02bc6fc26 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:43.399278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55099b7-0ddf-4ef8-8f9d-fbb02bc6fc26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:43.399555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55099b7-0ddf-4ef8-8f9d-fbb02bc6fc26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:43.458571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55099b7-0ddf-4ef8-8f9d-fbb02bc6fc26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:43.460707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55099b7-0ddf-4ef8-8f9d-fbb02bc6fc26 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:43.469916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1215/2428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:47.689212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f85c5-3d79-468d-be15-00866c3272f1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:47.700108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f85c5-3d79-468d-be15-00866c3272f1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:47.703684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bbbb9-7438-4de1-8490-5b77fe288d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:47.704299 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bbbb9-7438-4de1-8490-5b77fe288d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:47.704577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bbbb9-7438-4de1-8490-5b77fe288d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:47.704848 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bbbb9-7438-4de1-8490-5b77fe288d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:47.714583 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bbbb9-7438-4de1-8490-5b77fe288d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:47.716051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bbbb9-7438-4de1-8490-5b77fe288d5a service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:47.719947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:47.727498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1214/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:52.633989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55099b7-0ddf-4ef8-8f9d-fbb02bc6fc26 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:52.695206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55099b7-0ddf-4ef8-8f9d-fbb02bc6fc26 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:52.699665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:52.700291 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:52.700566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:52.700837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] PATH_INFO: `/v3/users/bb89b43abb864fbba7ba813cc21e10e5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:52.701982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb89b43abb864fbba7ba813cc21e10e5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:52.703937 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:52.749378 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb89b43abb864fbba7ba813cc21e10e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:52.756313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb89b43abb864fbba7ba813cc21e10e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:52.768736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb89b43abb864fbba7ba813cc21e10e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:52.769422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb89b43abb864fbba7ba813cc21e10e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:52.777266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb89b43abb864fbba7ba813cc21e10e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:52.783924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1216/2430] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:52 2022] DELETE /identity/v3/users/bb89b43abb864fbba7ba813cc21e10e5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:52.788618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e863c-c21b-4762-bf71-5db7333537c5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:52.789095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e863c-c21b-4762-bf71-5db7333537c5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:52.789213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e863c-c21b-4762-bf71-5db7333537c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:52.807993 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e22e863c-c21b-4762-bf71-5db7333537c5 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:58:52.809218 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e22e863c-c21b-4762-bf71-5db7333537c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:52.868389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1215/2431] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:58:52.880669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:52.883192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:52.917491 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:52.961018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4327-401b-4bb0-bb44-4b41afca324e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:52.965177 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de87a8-a3a9-4c08-b015-0d763c93c0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:52.965789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de87a8-a3a9-4c08-b015-0d763c93c0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:52.966070 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de87a8-a3a9-4c08-b015-0d763c93c0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:52.966348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de87a8-a3a9-4c08-b015-0d763c93c0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:52.976723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de87a8-a3a9-4c08-b015-0d763c93c0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:52.978182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de87a8-a3a9-4c08-b015-0d763c93c0d1 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:52.988262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1217/2432] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:58:53.278093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e863c-c21b-4762-bf71-5db7333537c5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:53.279588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e22e863c-c21b-4762-bf71-5db7333537c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:53.291620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e863c-c21b-4762-bf71-5db7333537c5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:53.296116 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:53.296799 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:53.297071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:53.297339 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] PATH_INFO: `/v3/projects/15dceea7c3ec4ee0acbedb366399e295` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:53.299082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15dceea7c3ec4ee0acbedb366399e295)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:53.300991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:53.350746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15dceea7c3ec4ee0acbedb366399e295', 'request_id': 'req-6b5a55af-da23-41e8-b3ca-7347e0c8b411'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.357952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15dceea7c3ec4ee0acbedb366399e295', 'request_id': 'req-6b5a55af-da23-41e8-b3ca-7347e0c8b411'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.363556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15dceea7c3ec4ee0acbedb366399e295', 'request_id': 'req-6b5a55af-da23-41e8-b3ca-7347e0c8b411'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.375981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] The token cache is being invalidate because project 15dceea7c3ec4ee0acbedb366399e295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:53.376268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.376913 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.378469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1216/2433] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:53 2022] DELETE /identity/v3/projects/15dceea7c3ec4ee0acbedb366399e295 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:53.383339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de87a8-a3a9-4c08-b015-0d763c93c0d1 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:53.395484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de87a8-a3a9-4c08-b015-0d763c93c0d1 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:53.456955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:53.457506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:53.457787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:53.458065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] PATH_INFO: `/v3/users/a2ff36575b9348a08750bfba624f20dd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:53.459318 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ff36575b9348a08750bfba624f20dd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:53.461283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:53.505979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ff36575b9348a08750bfba624f20dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.512993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ff36575b9348a08750bfba624f20dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.524667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ff36575b9348a08750bfba624f20dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.525290 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ff36575b9348a08750bfba624f20dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.532083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-be1a291c-d354-4772-8058-779df87ffa68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ff36575b9348a08750bfba624f20dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.538446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1218/2434] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 07:58:53 2022] DELETE /identity/v3/users/a2ff36575b9348a08750bfba624f20dd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 07:58:53.820582 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:58:53.822094 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:58:53.841320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a55af-da23-41e8-b3ca-7347e0c8b411 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:58:53.901389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:58:53.902170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:58:53.902559 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:58:53.902899 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] PATH_INFO: `/v3/projects/6aea3184378a4a478ed1097aca1b9341` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:58:53.904442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aea3184378a4a478ed1097aca1b9341)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:58:53.906820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:58:53.932851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:53.955409 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aea3184378a4a478ed1097aca1b9341', 'request_id': 'req-10053b50-8511-4632-853b-087dbbcf83a6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.962984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aea3184378a4a478ed1097aca1b9341', 'request_id': 'req-10053b50-8511-4632-853b-087dbbcf83a6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.968636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aea3184378a4a478ed1097aca1b9341', 'request_id': 'req-10053b50-8511-4632-853b-087dbbcf83a6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.980590 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] The token cache is being invalidate because project 6aea3184378a4a478ed1097aca1b9341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 07:58:53.980881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.981531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 07:58:53.983076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1217/2435] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 07:58:53 2022] DELETE /identity/v3/projects/6aea3184378a4a478ed1097aca1b9341 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 07:59:03.534462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:03.977465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:07.115344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7037f9-1b1d-4b9e-b961-d999fc5a8f5f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:07.115858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7037f9-1b1d-4b9e-b961-d999fc5a8f5f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:07.115960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7037f9-1b1d-4b9e-b961-d999fc5a8f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:07.145723 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cf7037f9-1b1d-4b9e-b961-d999fc5a8f5f None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:59:07.146991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cf7037f9-1b1d-4b9e-b961-d999fc5a8f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:07.204348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1219/2436] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:59:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:59:07.253769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:59:07.255265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:07.328979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10053b50-8511-4632-853b-087dbbcf83a6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:59:07.334109 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9689bf7-450e-4624-a02c-c6f59e69be89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:59:07.334766 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9689bf7-450e-4624-a02c-c6f59e69be89 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:07.335082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9689bf7-450e-4624-a02c-c6f59e69be89 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:07.335377 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9689bf7-450e-4624-a02c-c6f59e69be89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:07.344346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9689bf7-450e-4624-a02c-c6f59e69be89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:59:07.346191 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9689bf7-450e-4624-a02c-c6f59e69be89 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:59:07.354952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1218/2437] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:59:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:59:17.196912 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=29 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:17.351780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=32 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:25.494340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a0e2-4b10-4d73-8beb-bf2eee8a90bc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:25.494870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a0e2-4b10-4d73-8beb-bf2eee8a90bc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:25.494870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a0e2-4b10-4d73-8beb-bf2eee8a90bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:25.516162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2842a0e2-4b10-4d73-8beb-bf2eee8a90bc None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:59:25.517387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2842a0e2-4b10-4d73-8beb-bf2eee8a90bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:25.525197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1220/2438] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 27 07:59:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:59:25.537283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9689bf7-450e-4624-a02c-c6f59e69be89 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:59:25.548775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9689bf7-450e-4624-a02c-c6f59e69be89 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:59:25.556382 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b8638-59d2-4d39-bdde-4e7d637141d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:59:25.557192 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b8638-59d2-4d39-bdde-4e7d637141d2 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:25.557468 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b8638-59d2-4d39-bdde-4e7d637141d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:25.557737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b8638-59d2-4d39-bdde-4e7d637141d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:25.569794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b8638-59d2-4d39-bdde-4e7d637141d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:59:25.572346 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b8638-59d2-4d39-bdde-4e7d637141d2 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:59:25.585816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1219/2439] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:59:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 07:59:29.549552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842a0e2-4b10-4d73-8beb-bf2eee8a90bc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:59:29.551176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2842a0e2-4b10-4d73-8beb-bf2eee8a90bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:29.561997 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b8638-59d2-4d39-bdde-4e7d637141d2 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:59:29.563804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-585b8638-59d2-4d39-bdde-4e7d637141d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:29.625617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842a0e2-4b10-4d73-8beb-bf2eee8a90bc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:59:29.630729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:59:29.631484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:29.631834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:29.632206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:29.635218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:29.645325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b8638-59d2-4d39-bdde-4e7d637141d2 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:59:29.650057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877a561-4c5e-4493-851a-13e38fe6f417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:59:29.651122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877a561-4c5e-4493-851a-13e38fe6f417 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:29.651694 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877a561-4c5e-4493-851a-13e38fe6f417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:29.652244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877a561-4c5e-4493-851a-13e38fe6f417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:29.654471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9877a561-4c5e-4493-851a-13e38fe6f417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:29.719194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:59:29.720676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:59:29.736299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1221/2440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:59:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:59:29.746833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877a561-4c5e-4493-851a-13e38fe6f417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:59:29.748739 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877a561-4c5e-4493-851a-13e38fe6f417 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:59:29.763986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1220/2441] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:59:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 07:59:33.356927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:59:33.358485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:33.370518 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030f3ad-c201-4374-8487-0151ee5acf1a service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:59:33.374264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:59:33.374953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:33.375246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:33.375523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:33.377419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:33.393234 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:59:33.395104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:59:33.409611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1222/2442] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:59:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:59:39.756028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=60 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:43.404076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=57 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:45.017832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac49037-edf4-49f1-8735-09995d39b497 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:45.018356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac49037-edf4-49f1-8735-09995d39b497 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:45.018356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac49037-edf4-49f1-8735-09995d39b497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:45.039348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1ac49037-edf4-49f1-8735-09995d39b497 None None] MFA Rules not processed for user `5efb3ea424f8450c883d4757545af18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:59:45.040616 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1ac49037-edf4-49f1-8735-09995d39b497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:45.048056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1221/2443] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 07:59:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:59:49.920505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:59:49.921931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:49.980173 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63697a9b-1cce-4d50-8016-70e97c40a1b8 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:59:49.983913 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4c42-eb77-4dbe-ac66-2aaef3c78fa0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7a3c5f6b9645fb8cd2a65cee4f37c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:59:49.984529 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4c42-eb77-4dbe-ac66-2aaef3c78fa0 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:49.984808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4c42-eb77-4dbe-ac66-2aaef3c78fa0 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:49.985082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4c42-eb77-4dbe-ac66-2aaef3c78fa0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:49.986833 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d9fd4c42-eb77-4dbe-ac66-2aaef3c78fa0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:50.071669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd4c42-eb77-4dbe-ac66-2aaef3c78fa0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:59:50.073125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd4c42-eb77-4dbe-ac66-2aaef3c78fa0 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:59:50.091367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1223/2444] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 07:59:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 07:59:50.122010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c555d7-ed87-44ad-8a64-fe648f111b5b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:50.122473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c555d7-ed87-44ad-8a64-fe648f111b5b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:50.122568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c555d7-ed87-44ad-8a64-fe648f111b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:50.142561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f0c555d7-ed87-44ad-8a64-fe648f111b5b None None] MFA Rules not processed for user `cc423c22d64144d6aece926a64444e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 07:59:50.143832 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f0c555d7-ed87-44ad-8a64-fe648f111b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 07:59:50.151262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1222/2445] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 27 07:59:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 07:59:50.163931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4c42-eb77-4dbe-ac66-2aaef3c78fa0 service glance] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 07:59:50.175337 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4c42-eb77-4dbe-ac66-2aaef3c78fa0 service glance] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 07:59:50.180739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca27f-1c8f-448e-9c86-3d5e570f1736 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5bb94b71d1c452a88f1594a6b011ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 07:59:50.181344 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca27f-1c8f-448e-9c86-3d5e570f1736 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 07:59:50.181618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca27f-1c8f-448e-9c86-3d5e570f1736 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 07:59:50.181893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca27f-1c8f-448e-9c86-3d5e570f1736 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 07:59:50.190629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca27f-1c8f-448e-9c86-3d5e570f1736 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 07:59:50.192260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca27f-1c8f-448e-9c86-3d5e570f1736 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 07:59:50.201611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1224/2446] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 27 07:59:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:00:00.137013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:00.198684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=67 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:03.242856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c555d7-ed87-44ad-8a64-fe648f111b5b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:03.252887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c555d7-ed87-44ad-8a64-fe648f111b5b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:03.253507 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca27f-1c8f-448e-9c86-3d5e570f1736 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:03.258139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:03.258842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:03.259213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:03.259553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:03.261371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:03.264962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca27f-1c8f-448e-9c86-3d5e570f1736 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:03.269223 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f60cc-3486-4ef5-847e-82a373e222bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:03.269972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f60cc-3486-4ef5-847e-82a373e222bc service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:03.270263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f60cc-3486-4ef5-847e-82a373e222bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:03.271211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f60cc-3486-4ef5-847e-82a373e222bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:03.273165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dd9f60cc-3486-4ef5-847e-82a373e222bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:03.283510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f60cc-3486-4ef5-847e-82a373e222bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:03.284949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f60cc-3486-4ef5-847e-82a373e222bc service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:03.293118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1225/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:00:03.327407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:03.328858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:03.339675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1223/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:06.514413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f60cc-3486-4ef5-847e-82a373e222bc service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:06.523439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f60cc-3486-4ef5-847e-82a373e222bc service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:06.527445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ed1a7-9f8a-4e2f-b8c3-270292d5b1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:06.528170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ed1a7-9f8a-4e2f-b8c3-270292d5b1db service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:06.528461 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ed1a7-9f8a-4e2f-b8c3-270292d5b1db service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:06.528739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ed1a7-9f8a-4e2f-b8c3-270292d5b1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:06.530601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-215ed1a7-9f8a-4e2f-b8c3-270292d5b1db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:06.605929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ed1a7-9f8a-4e2f-b8c3-270292d5b1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:06.607517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ed1a7-9f8a-4e2f-b8c3-270292d5b1db service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:06.620434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1226/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:06.726259 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:06.727873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:06.743645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe080-e8db-4e3f-9381-158785ebac61 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:06.749606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:06.750562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:06.751044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:06.751489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] PATH_INFO: `/v3/users/7e3a5b392d9d44859110f048bea7331b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:06.767931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3a5b392d9d44859110f048bea7331b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:06.771470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:06.829499 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3a5b392d9d44859110f048bea7331b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:06.847246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3a5b392d9d44859110f048bea7331b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:06.849170 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3a5b392d9d44859110f048bea7331b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:06.859533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3a5b392d9d44859110f048bea7331b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:06.860216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3d678e66-02df-4210-bbe3-418cb95575f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3a5b392d9d44859110f048bea7331b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:06.876663 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1224/2450] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:00:06 2022] DELETE /identity/v3/users/7e3a5b392d9d44859110f048bea7331b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:07.105032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ed1a7-9f8a-4e2f-b8c3-270292d5b1db service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:07.147523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ed1a7-9f8a-4e2f-b8c3-270292d5b1db service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:07.221000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:07.221651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.221927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.222201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] PATH_INFO: `/v3/projects/88e9fffbb5c6457ca3bc45c6226230a3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.234200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e9fffbb5c6457ca3bc45c6226230a3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:07.236190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:07.290513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e9fffbb5c6457ca3bc45c6226230a3', 'request_id': 'req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:07.298561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e9fffbb5c6457ca3bc45c6226230a3', 'request_id': 'req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:07.305533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e9fffbb5c6457ca3bc45c6226230a3', 'request_id': 'req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:07.317419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] The token cache is being invalidate because project 88e9fffbb5c6457ca3bc45c6226230a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:00:07.318329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:07.319016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4b4e683-2091-49d9-bf27-c6ee2eb6cbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:07.320525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1227/2451] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:00:07 2022] DELETE /identity/v3/projects/88e9fffbb5c6457ca3bc45c6226230a3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:07.325394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac0ad2-8cf8-400c-bbb1-88497198b152 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.325709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac0ad2-8cf8-400c-bbb1-88497198b152 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.326189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac0ad2-8cf8-400c-bbb1-88497198b152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.347077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-caac0ad2-8cf8-400c-bbb1-88497198b152 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:00:07.348159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-caac0ad2-8cf8-400c-bbb1-88497198b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:07.400695 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:07.415736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1225/2452] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:00:07.424242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92886e71-7f8c-45c9-bbd1-7981d9d19540 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.426377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92886e71-7f8c-45c9-bbd1-7981d9d19540 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.427295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92886e71-7f8c-45c9-bbd1-7981d9d19540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.435962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:07.450767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-92886e71-7f8c-45c9-bbd1-7981d9d19540 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:00:07.452144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-92886e71-7f8c-45c9-bbd1-7981d9d19540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:07.462008 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1228/2453] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:00:07.466180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac0ad2-8cf8-400c-bbb1-88497198b152 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:07.476742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac0ad2-8cf8-400c-bbb1-88497198b152 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:07.481623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4878b-3a70-4b3a-a9c5-0b5ca3581d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:07.482442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4878b-3a70-4b3a-a9c5-0b5ca3581d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.482794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4878b-3a70-4b3a-a9c5-0b5ca3581d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.483167 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4878b-3a70-4b3a-a9c5-0b5ca3581d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.483947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4878b-3a70-4b3a-a9c5-0b5ca3581d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:00:07.484322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4878b-3a70-4b3a-a9c5-0b5ca3581d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:07.486021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4878b-3a70-4b3a-a9c5-0b5ca3581d13 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:07.500160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1226/2454] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:00:07.505362 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92886e71-7f8c-45c9-bbd1-7981d9d19540 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:07.517542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92886e71-7f8c-45c9-bbd1-7981d9d19540 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:07.522903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f52ffb-2d72-40db-aa55-f8fdcb1afddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:07.523538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52ffb-2d72-40db-aa55-f8fdcb1afddc admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.523866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52ffb-2d72-40db-aa55-f8fdcb1afddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.524325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52ffb-2d72-40db-aa55-f8fdcb1afddc admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.524996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f52ffb-2d72-40db-aa55-f8fdcb1afddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:07.526935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f52ffb-2d72-40db-aa55-f8fdcb1afddc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:07.569596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1229/2455] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:00:07 2022] POST /identity/v3/projects => generated 355 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:00:07.574158 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4878b-3a70-4b3a-a9c5-0b5ca3581d13 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:07.589929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4878b-3a70-4b3a-a9c5-0b5ca3581d13 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:07.660441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee825-f34e-44a4-8318-d1fd4f86b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:07.660441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee825-f34e-44a4-8318-d1fd4f86b3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.661607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee825-f34e-44a4-8318-d1fd4f86b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.661607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee825-f34e-44a4-8318-d1fd4f86b3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.662200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cee825-f34e-44a4-8318-d1fd4f86b3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:07.665061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cee825-f34e-44a4-8318-d1fd4f86b3c2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:07.690180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1227/2456] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:00:07 2022] POST /identity/v3/users => generated 278 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:00:07.691430 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f52ffb-2d72-40db-aa55-f8fdcb1afddc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:07.702481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f52ffb-2d72-40db-aa55-f8fdcb1afddc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:07.707737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b701b-2c37-4b36-9e1b-d244c7256d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:07.708897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b701b-2c37-4b36-9e1b-d244c7256d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.709176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b701b-2c37-4b36-9e1b-d244c7256d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.709639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b701b-2c37-4b36-9e1b-d244c7256d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.710345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b701b-2c37-4b36-9e1b-d244c7256d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:07.712018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b701b-2c37-4b36-9e1b-d244c7256d9e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:07.723687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1230/2457] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:00:07.727754 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee825-f34e-44a4-8318-d1fd4f86b3c2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:07.738524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee825-f34e-44a4-8318-d1fd4f86b3c2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:07.743296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaafb14-8582-490c-b1eb-5df98eeeb74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:07.743909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaafb14-8582-490c-b1eb-5df98eeeb74c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.744186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaafb14-8582-490c-b1eb-5df98eeeb74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.744454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaafb14-8582-490c-b1eb-5df98eeeb74c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.745165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaafb14-8582-490c-b1eb-5df98eeeb74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:07.746780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaafb14-8582-490c-b1eb-5df98eeeb74c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:07.758813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1228/2458] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:00:07.763328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b701b-2c37-4b36-9e1b-d244c7256d9e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:07.774402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b701b-2c37-4b36-9e1b-d244c7256d9e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:07.779208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ba7e-3928-4bf8-927a-67e6369df2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:07.779877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ba7e-3928-4bf8-927a-67e6369df2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.780232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ba7e-3928-4bf8-927a-67e6369df2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.780510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ba7e-3928-4bf8-927a-67e6369df2cd admin admin] PATH_INFO: `/v3/projects/603581e462c14a619838afb934237466/users/b64101cbe98f4b41893b5c17410a8752/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.795631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5ba7e-3928-4bf8-927a-67e6369df2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=603581e462c14a619838afb934237466, user_id=b64101cbe98f4b41893b5c17410a8752, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:07.798322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5ba7e-3928-4bf8-927a-67e6369df2cd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:07.812243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1231/2459] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:00:07 2022] PUT /identity/v3/projects/603581e462c14a619838afb934237466/users/b64101cbe98f4b41893b5c17410a8752/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:07.824949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34287f-4986-43a8-a04d-bd12a06090cc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:07.825273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34287f-4986-43a8-a04d-bd12a06090cc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:07.825577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34287f-4986-43a8-a04d-bd12a06090cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:07.859396 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cc34287f-4986-43a8-a04d-bd12a06090cc None None] MFA Rules not processed for user `b64101cbe98f4b41893b5c17410a8752`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:00:07.860555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cc34287f-4986-43a8-a04d-bd12a06090cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:07.932207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1229/2460] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:00:07 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:00:07.936752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ba7e-3928-4bf8-927a-67e6369df2cd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:08.001819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ba7e-3928-4bf8-927a-67e6369df2cd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:08.007175 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532fe39-d0ec-4028-96bd-0adcdff82622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:08.007795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532fe39-d0ec-4028-96bd-0adcdff82622 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:08.008076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532fe39-d0ec-4028-96bd-0adcdff82622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:08.008349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532fe39-d0ec-4028-96bd-0adcdff82622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:08.009015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532fe39-d0ec-4028-96bd-0adcdff82622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:08.010964 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532fe39-d0ec-4028-96bd-0adcdff82622 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:08.047125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1232/2461] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:00:07 2022] POST /identity/v3/projects => generated 355 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:00:08.051310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34287f-4986-43a8-a04d-bd12a06090cc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:08.063223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34287f-4986-43a8-a04d-bd12a06090cc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:08.112516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:08.124000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416bb2-f573-480f-bb6b-c6bd9fd45e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:08.124666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416bb2-f573-480f-bb6b-c6bd9fd45e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:08.125063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416bb2-f573-480f-bb6b-c6bd9fd45e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:08.125323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416bb2-f573-480f-bb6b-c6bd9fd45e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:08.126406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416bb2-f573-480f-bb6b-c6bd9fd45e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:08.128255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416bb2-f573-480f-bb6b-c6bd9fd45e74 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:08.150552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1230/2462] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:00:08 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:00:08.154665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532fe39-d0ec-4028-96bd-0adcdff82622 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:08.166907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532fe39-d0ec-4028-96bd-0adcdff82622 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:08.174159 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe42bb-3126-47bd-b9f7-3fa7955d8cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:08.175041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe42bb-3126-47bd-b9f7-3fa7955d8cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:08.175041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe42bb-3126-47bd-b9f7-3fa7955d8cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:08.175501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe42bb-3126-47bd-b9f7-3fa7955d8cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:08.176283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe42bb-3126-47bd-b9f7-3fa7955d8cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:08.177999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe42bb-3126-47bd-b9f7-3fa7955d8cc0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:08.189905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1233/2463] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:00:08.195845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416bb2-f573-480f-bb6b-c6bd9fd45e74 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:08.206392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416bb2-f573-480f-bb6b-c6bd9fd45e74 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:08.212039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841c1c2-f312-48a4-9416-5a81508ead61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:08.212722 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841c1c2-f312-48a4-9416-5a81508ead61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:08.213000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841c1c2-f312-48a4-9416-5a81508ead61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:08.213272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841c1c2-f312-48a4-9416-5a81508ead61 admin admin] PATH_INFO: `/v3/projects/ba81393fb17f49668bc9452601eb28b6/users/08a66da5031b49e797e8a0952b4970ee/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:08.229519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841c1c2-f312-48a4-9416-5a81508ead61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba81393fb17f49668bc9452601eb28b6, user_id=08a66da5031b49e797e8a0952b4970ee, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:08.232238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841c1c2-f312-48a4-9416-5a81508ead61 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:08.245919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1231/2464] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:00:08 2022] PUT /identity/v3/projects/ba81393fb17f49668bc9452601eb28b6/users/08a66da5031b49e797e8a0952b4970ee/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:08.249969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe42bb-3126-47bd-b9f7-3fa7955d8cc0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:08.264495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe42bb-3126-47bd-b9f7-3fa7955d8cc0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:08.325436 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816a24d-6ce8-4b88-aa8e-484057dce572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:08.326053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816a24d-6ce8-4b88-aa8e-484057dce572 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:08.326334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816a24d-6ce8-4b88-aa8e-484057dce572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:08.326605 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816a24d-6ce8-4b88-aa8e-484057dce572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:08.327328 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816a24d-6ce8-4b88-aa8e-484057dce572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:08.328918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816a24d-6ce8-4b88-aa8e-484057dce572 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:08.334642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:08.340227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1234/2465] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:00:08.344677 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841c1c2-f312-48a4-9416-5a81508ead61 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:08.356534 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841c1c2-f312-48a4-9416-5a81508ead61 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:08.361282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09102baa-3a02-484b-9f06-4967839d5e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:08.361985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09102baa-3a02-484b-9f06-4967839d5e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:08.362265 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09102baa-3a02-484b-9f06-4967839d5e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:08.362600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09102baa-3a02-484b-9f06-4967839d5e85 admin admin] PATH_INFO: `/v3/projects/ba81393fb17f49668bc9452601eb28b6/users/08a66da5031b49e797e8a0952b4970ee/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:08.364683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09102baa-3a02-484b-9f06-4967839d5e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba81393fb17f49668bc9452601eb28b6, user_id=08a66da5031b49e797e8a0952b4970ee, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:08.367401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09102baa-3a02-484b-9f06-4967839d5e85 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:08.378807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1232/2466] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:00:08 2022] PUT /identity/v3/projects/ba81393fb17f49668bc9452601eb28b6/users/08a66da5031b49e797e8a0952b4970ee/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:08.388917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee16d-8357-4986-9956-2a588f64e65b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:08.389210 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee16d-8357-4986-9956-2a588f64e65b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:08.389492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee16d-8357-4986-9956-2a588f64e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:08.427413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-412ee16d-8357-4986-9956-2a588f64e65b None None] MFA Rules not processed for user `08a66da5031b49e797e8a0952b4970ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:00:08.428667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-412ee16d-8357-4986-9956-2a588f64e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:08.501613 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1235/2467] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:00:08 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:00:08.514250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09102baa-3a02-484b-9f06-4967839d5e85 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:08.516439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-09102baa-3a02-484b-9f06-4967839d5e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:08.580930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09102baa-3a02-484b-9f06-4967839d5e85 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:08.585412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcff179-4b8e-4fb9-8f26-def2e97f4224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:08.586114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcff179-4b8e-4fb9-8f26-def2e97f4224 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:08.586461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcff179-4b8e-4fb9-8f26-def2e97f4224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:08.586804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcff179-4b8e-4fb9-8f26-def2e97f4224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:08.597835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcff179-4b8e-4fb9-8f26-def2e97f4224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:08.599338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcff179-4b8e-4fb9-8f26-def2e97f4224 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:08.609228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1233/2468] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:08 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:08.697712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ee16d-8357-4986-9956-2a588f64e65b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:08.709253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ee16d-8357-4986-9956-2a588f64e65b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:08.713994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429b14d-881f-4a35-8423-10b4aafb5729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:08.714627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429b14d-881f-4a35-8423-10b4aafb5729 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:08.714932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429b14d-881f-4a35-8423-10b4aafb5729 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:08.715214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429b14d-881f-4a35-8423-10b4aafb5729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:08.783347 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429b14d-881f-4a35-8423-10b4aafb5729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:08.785197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429b14d-881f-4a35-8423-10b4aafb5729 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:08.796527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1236/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:08 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:18.604788 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=47,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:18.791469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=62 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:23.843704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcff179-4b8e-4fb9-8f26-def2e97f4224 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:23.906645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcff179-4b8e-4fb9-8f26-def2e97f4224 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:23.911441 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:23.912077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:23.912364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:23.912632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] PATH_INFO: `/v3/users/b64101cbe98f4b41893b5c17410a8752` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:23.913799 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64101cbe98f4b41893b5c17410a8752)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:23.915815 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:23.962546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64101cbe98f4b41893b5c17410a8752'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:23.974490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64101cbe98f4b41893b5c17410a8752'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:23.975232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64101cbe98f4b41893b5c17410a8752'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:23.982513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64101cbe98f4b41893b5c17410a8752'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:23.983156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64101cbe98f4b41893b5c17410a8752'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:23.995619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1234/2470] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:00:23 2022] DELETE /identity/v3/users/b64101cbe98f4b41893b5c17410a8752 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:24.000102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a92f-2f2f-4522-87c1-9b195e4c2d36 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:24.000581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a92f-2f2f-4522-87c1-9b195e4c2d36 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:24.000707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a92f-2f2f-4522-87c1-9b195e4c2d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:24.020042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0480a92f-2f2f-4522-87c1-9b195e4c2d36 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:00:24.021253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0480a92f-2f2f-4522-87c1-9b195e4c2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:24.081423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1237/2471] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:00:24.091177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:24.092598 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:24.150039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170103c7-c16a-444a-9bfd-e0772eb575c4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:24.153728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400ef08-b915-420d-8bf1-2d07ee902c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:24.154340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400ef08-b915-420d-8bf1-2d07ee902c1c service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:24.154621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400ef08-b915-420d-8bf1-2d07ee902c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:24.154909 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400ef08-b915-420d-8bf1-2d07ee902c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:24.163954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400ef08-b915-420d-8bf1-2d07ee902c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:24.165375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400ef08-b915-420d-8bf1-2d07ee902c1c service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:24.174770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1235/2472] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:24.491054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480a92f-2f2f-4522-87c1-9b195e4c2d36 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:24.493152 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0480a92f-2f2f-4522-87c1-9b195e4c2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:24.508181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480a92f-2f2f-4522-87c1-9b195e4c2d36 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:24.513887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:24.514561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:24.514872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:24.515190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] PATH_INFO: `/v3/projects/603581e462c14a619838afb934237466` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:24.516366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=603581e462c14a619838afb934237466)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:24.518601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:24.570800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603581e462c14a619838afb934237466', 'request_id': 'req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.579748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603581e462c14a619838afb934237466', 'request_id': 'req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.587170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603581e462c14a619838afb934237466', 'request_id': 'req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.600703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] The token cache is being invalidate because project 603581e462c14a619838afb934237466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:00:24.601086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.601891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.603918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1238/2473] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:00:24 2022] DELETE /identity/v3/projects/603581e462c14a619838afb934237466 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:24.608484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400ef08-b915-420d-8bf1-2d07ee902c1c service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:24.618721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400ef08-b915-420d-8bf1-2d07ee902c1c service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:24.639786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:24.685112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:24.685837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:24.686189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:24.686532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] PATH_INFO: `/v3/users/08a66da5031b49e797e8a0952b4970ee` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:24.687956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a66da5031b49e797e8a0952b4970ee)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:24.700777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:24.746907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a66da5031b49e797e8a0952b4970ee'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.761619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a66da5031b49e797e8a0952b4970ee'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.762521 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a66da5031b49e797e8a0952b4970ee'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.770806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a66da5031b49e797e8a0952b4970ee'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.771544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47a2f260-fc04-48c1-8ca4-4c7070cf4d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a66da5031b49e797e8a0952b4970ee'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:24.786954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1236/2474] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:00:24 2022] DELETE /identity/v3/users/08a66da5031b49e797e8a0952b4970ee => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:25.063948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.065389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:25.081031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ac84d-80b7-4fce-8e5a-7419b90339b4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:25.137348 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:25.137980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.138256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.138526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] PATH_INFO: `/v3/projects/ba81393fb17f49668bc9452601eb28b6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.139761 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba81393fb17f49668bc9452601eb28b6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:25.141617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:25.171174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:25.188911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba81393fb17f49668bc9452601eb28b6', 'request_id': 'req-1b180e9e-dda2-4610-8056-501ab27192e1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:25.197129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba81393fb17f49668bc9452601eb28b6', 'request_id': 'req-1b180e9e-dda2-4610-8056-501ab27192e1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:25.202381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba81393fb17f49668bc9452601eb28b6', 'request_id': 'req-1b180e9e-dda2-4610-8056-501ab27192e1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:25.214664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] The token cache is being invalidate because project ba81393fb17f49668bc9452601eb28b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:00:25.214986 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:25.215642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b180e9e-dda2-4610-8056-501ab27192e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:00:25.217180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1239/2475] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:00:25 2022] DELETE /identity/v3/projects/ba81393fb17f49668bc9452601eb28b6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:25.222827 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520f924-a779-4da1-9803-2b4a3ea5714f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.223405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520f924-a779-4da1-9803-2b4a3ea5714f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.223405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520f924-a779-4da1-9803-2b4a3ea5714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.242769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5520f924-a779-4da1-9803-2b4a3ea5714f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:00:25.244014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5520f924-a779-4da1-9803-2b4a3ea5714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:25.306385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1237/2476] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:00:25.315790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94356-c1ce-41ad-a14c-a0fbbdba728d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.316145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94356-c1ce-41ad-a14c-a0fbbdba728d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.316481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94356-c1ce-41ad-a14c-a0fbbdba728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.336815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-97d94356-c1ce-41ad-a14c-a0fbbdba728d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:00:25.338025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-97d94356-c1ce-41ad-a14c-a0fbbdba728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:25.345992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1240/2477] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:00:25.350816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520f924-a779-4da1-9803-2b4a3ea5714f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.360674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520f924-a779-4da1-9803-2b4a3ea5714f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:25.365797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eec0d-5106-44b4-a8f0-14266fa06aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:25.366413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eec0d-5106-44b4-a8f0-14266fa06aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.366702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eec0d-5106-44b4-a8f0-14266fa06aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.367005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eec0d-5106-44b4-a8f0-14266fa06aa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.367714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eec0d-5106-44b4-a8f0-14266fa06aa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:00:25.368018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eec0d-5106-44b4-a8f0-14266fa06aa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:25.369613 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eec0d-5106-44b4-a8f0-14266fa06aa0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:25.381588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1238/2478] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:00:25.385830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d94356-c1ce-41ad-a14c-a0fbbdba728d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.395460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d94356-c1ce-41ad-a14c-a0fbbdba728d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:25.400045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c688fe-4d86-4cf6-9196-0a0637bb113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:25.400644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c688fe-4d86-4cf6-9196-0a0637bb113f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.400925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c688fe-4d86-4cf6-9196-0a0637bb113f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.401199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c688fe-4d86-4cf6-9196-0a0637bb113f admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.401866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c688fe-4d86-4cf6-9196-0a0637bb113f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:25.403813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c688fe-4d86-4cf6-9196-0a0637bb113f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:25.434564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1241/2479] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:00:25 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:00:25.438742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eec0d-5106-44b4-a8f0-14266fa06aa0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.449490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eec0d-5106-44b4-a8f0-14266fa06aa0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:25.475498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:25.508232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0955b1b-8d19-4194-8b64-cccd9d50872b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:25.508860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0955b1b-8d19-4194-8b64-cccd9d50872b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.509144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0955b1b-8d19-4194-8b64-cccd9d50872b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.509419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0955b1b-8d19-4194-8b64-cccd9d50872b admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.510398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0955b1b-8d19-4194-8b64-cccd9d50872b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:25.512124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0955b1b-8d19-4194-8b64-cccd9d50872b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:25.533394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1239/2480] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:00:25 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:00:25.538124 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c688fe-4d86-4cf6-9196-0a0637bb113f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.548366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c688fe-4d86-4cf6-9196-0a0637bb113f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:25.553002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74def2-2975-4ab9-bc85-7655ae189ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:25.553585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74def2-2975-4ab9-bc85-7655ae189ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.553862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74def2-2975-4ab9-bc85-7655ae189ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.554131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74def2-2975-4ab9-bc85-7655ae189ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.554817 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74def2-2975-4ab9-bc85-7655ae189ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:25.556446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74def2-2975-4ab9-bc85-7655ae189ea9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:25.566227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1242/2481] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:00:25.570240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0955b1b-8d19-4194-8b64-cccd9d50872b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.580990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0955b1b-8d19-4194-8b64-cccd9d50872b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:25.586494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00085fe-136d-4aaa-b6e8-15f901203e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:25.587152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00085fe-136d-4aaa-b6e8-15f901203e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.587481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00085fe-136d-4aaa-b6e8-15f901203e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.587756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00085fe-136d-4aaa-b6e8-15f901203e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.588484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00085fe-136d-4aaa-b6e8-15f901203e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:25.590093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00085fe-136d-4aaa-b6e8-15f901203e74 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:25.601611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1240/2482] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:00:25.605779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74def2-2975-4ab9-bc85-7655ae189ea9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.616163 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74def2-2975-4ab9-bc85-7655ae189ea9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:25.620967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f65ae-58ed-47be-8103-a772758a2c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:25.621630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f65ae-58ed-47be-8103-a772758a2c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.621917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f65ae-58ed-47be-8103-a772758a2c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.622194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f65ae-58ed-47be-8103-a772758a2c76 admin admin] PATH_INFO: `/v3/projects/f862b8836fdd4c7ab44273c8dc0a03ab/users/27ef532cf5e944548f2a2d82abd69fe1/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.636928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f65ae-58ed-47be-8103-a772758a2c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f862b8836fdd4c7ab44273c8dc0a03ab, user_id=27ef532cf5e944548f2a2d82abd69fe1, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:25.639786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f65ae-58ed-47be-8103-a772758a2c76 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:25.654076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1243/2483] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:00:25 2022] PUT /identity/v3/projects/f862b8836fdd4c7ab44273c8dc0a03ab/users/27ef532cf5e944548f2a2d82abd69fe1/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:25.665389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ab53b-9b01-475c-9c69-b346386dab46 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.665685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ab53b-9b01-475c-9c69-b346386dab46 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.665956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ab53b-9b01-475c-9c69-b346386dab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.694190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1b3ab53b-9b01-475c-9c69-b346386dab46 None None] MFA Rules not processed for user `27ef532cf5e944548f2a2d82abd69fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:00:25.695451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1b3ab53b-9b01-475c-9c69-b346386dab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:25.760459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1241/2484] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:00:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:00:25.765480 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f65ae-58ed-47be-8103-a772758a2c76 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.829919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f65ae-58ed-47be-8103-a772758a2c76 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:25.835419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136870e-d5b6-4918-8369-6ec10ff1bf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:25.835956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136870e-d5b6-4918-8369-6ec10ff1bf32 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.836257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136870e-d5b6-4918-8369-6ec10ff1bf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.836626 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136870e-d5b6-4918-8369-6ec10ff1bf32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.837197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136870e-d5b6-4918-8369-6ec10ff1bf32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:25.839193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136870e-d5b6-4918-8369-6ec10ff1bf32 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:25.871735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1244/2485] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:00:25 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:00:25.872911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ab53b-9b01-475c-9c69-b346386dab46 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.891172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ab53b-9b01-475c-9c69-b346386dab46 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:25.949955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bfd71-0c47-4f05-8c80-7c9b59884040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:25.950589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bfd71-0c47-4f05-8c80-7c9b59884040 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:25.950872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bfd71-0c47-4f05-8c80-7c9b59884040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:25.951180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bfd71-0c47-4f05-8c80-7c9b59884040 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:25.951901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bfd71-0c47-4f05-8c80-7c9b59884040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:25.953868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bfd71-0c47-4f05-8c80-7c9b59884040 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:25.978480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1242/2486] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:00:25 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:00:25.983994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136870e-d5b6-4918-8369-6ec10ff1bf32 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:25.996161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136870e-d5b6-4918-8369-6ec10ff1bf32 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:26.001452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ddbed-3ab7-44e4-bd10-0ae9c5be3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:26.002161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ddbed-3ab7-44e4-bd10-0ae9c5be3ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:26.002445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ddbed-3ab7-44e4-bd10-0ae9c5be3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:26.002725 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ddbed-3ab7-44e4-bd10-0ae9c5be3ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:26.003627 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ddbed-3ab7-44e4-bd10-0ae9c5be3ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:26.005301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ddbed-3ab7-44e4-bd10-0ae9c5be3ee1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:26.016936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1245/2487] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:00:26.021258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bfd71-0c47-4f05-8c80-7c9b59884040 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:26.031361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bfd71-0c47-4f05-8c80-7c9b59884040 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:26.037028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1533fb4-a5bc-4739-ab47-a798fab4fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:26.037697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1533fb4-a5bc-4739-ab47-a798fab4fbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:26.038007 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1533fb4-a5bc-4739-ab47-a798fab4fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:26.038484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1533fb4-a5bc-4739-ab47-a798fab4fbc0 admin admin] PATH_INFO: `/v3/projects/07be385333b84691901d7785594164f9/users/0f622ad2213849498127b132ce8847a3/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:26.056504 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1533fb4-a5bc-4739-ab47-a798fab4fbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07be385333b84691901d7785594164f9, user_id=0f622ad2213849498127b132ce8847a3, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:26.059281 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1533fb4-a5bc-4739-ab47-a798fab4fbc0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:26.073164 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1243/2488] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:00:26 2022] PUT /identity/v3/projects/07be385333b84691901d7785594164f9/users/0f622ad2213849498127b132ce8847a3/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:00:26.078136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ddbed-3ab7-44e4-bd10-0ae9c5be3ee1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:26.089592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ddbed-3ab7-44e4-bd10-0ae9c5be3ee1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:26.121856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:26.173288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae9904-883f-401f-9423-e646041592dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:26.174200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9904-883f-401f-9423-e646041592dc admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:26.174476 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9904-883f-401f-9423-e646041592dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:26.174744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9904-883f-401f-9423-e646041592dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:26.175504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae9904-883f-401f-9423-e646041592dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:26.177181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae9904-883f-401f-9423-e646041592dc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:26.187821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1246/2489] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:00:26.192203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1533fb4-a5bc-4739-ab47-a798fab4fbc0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:26.197764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:26.204379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1533fb4-a5bc-4739-ab47-a798fab4fbc0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:26.210534 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6e497-90d7-4668-ab77-11bf132fd6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:26.211357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6e497-90d7-4668-ab77-11bf132fd6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:26.211759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6e497-90d7-4668-ab77-11bf132fd6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:26.212126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6e497-90d7-4668-ab77-11bf132fd6c1 admin admin] PATH_INFO: `/v3/projects/07be385333b84691901d7785594164f9/users/0f622ad2213849498127b132ce8847a3/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:26.214281 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6e497-90d7-4668-ab77-11bf132fd6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07be385333b84691901d7785594164f9, user_id=0f622ad2213849498127b132ce8847a3, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:26.217119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6e497-90d7-4668-ab77-11bf132fd6c1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:26.228537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1244/2490] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:00:26 2022] PUT /identity/v3/projects/07be385333b84691901d7785594164f9/users/0f622ad2213849498127b132ce8847a3/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:00:26.240448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0deb27-b9e2-46cb-adbf-d7bb7971a14c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:26.240777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0deb27-b9e2-46cb-adbf-d7bb7971a14c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:26.241060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0deb27-b9e2-46cb-adbf-d7bb7971a14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:26.271453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3e0deb27-b9e2-46cb-adbf-d7bb7971a14c None None] MFA Rules not processed for user `0f622ad2213849498127b132ce8847a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:00:26.272702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3e0deb27-b9e2-46cb-adbf-d7bb7971a14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:26.350849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1247/2491] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:00:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:00:26.361659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6e497-90d7-4668-ab77-11bf132fd6c1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:26.363416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-21e6e497-90d7-4668-ab77-11bf132fd6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:26.421029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6e497-90d7-4668-ab77-11bf132fd6c1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:26.427401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf761f34-ce38-491e-9f12-d9aec3b85c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:26.428032 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf761f34-ce38-491e-9f12-d9aec3b85c05 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:26.428317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf761f34-ce38-491e-9f12-d9aec3b85c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:26.428619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf761f34-ce38-491e-9f12-d9aec3b85c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:26.484942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf761f34-ce38-491e-9f12-d9aec3b85c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:26.486404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf761f34-ce38-491e-9f12-d9aec3b85c05 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:26.495491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1245/2492] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:33.171524 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0deb27-b9e2-46cb-adbf-d7bb7971a14c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:33.181936 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0deb27-b9e2-46cb-adbf-d7bb7971a14c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:33.190236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573faa4b-9291-49e4-aae8-c6bd9f197b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:33.190860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573faa4b-9291-49e4-aae8-c6bd9f197b06 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:33.191193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573faa4b-9291-49e4-aae8-c6bd9f197b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:33.191462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573faa4b-9291-49e4-aae8-c6bd9f197b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:33.201975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573faa4b-9291-49e4-aae8-c6bd9f197b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:33.203432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573faa4b-9291-49e4-aae8-c6bd9f197b06 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:33.214135 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1248/2493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:36.491416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:41.073800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf761f34-ce38-491e-9f12-d9aec3b85c05 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:41.075284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cf761f34-ce38-491e-9f12-d9aec3b85c05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:41.131054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf761f34-ce38-491e-9f12-d9aec3b85c05 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:41.135417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1d68-79f1-43f6-a308-85dc5114fc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:41.136032 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1d68-79f1-43f6-a308-85dc5114fc91 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:41.136315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1d68-79f1-43f6-a308-85dc5114fc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:41.136589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1d68-79f1-43f6-a308-85dc5114fc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:41.138351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f25c1d68-79f1-43f6-a308-85dc5114fc91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:41.200142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c1d68-79f1-43f6-a308-85dc5114fc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:41.201498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c1d68-79f1-43f6-a308-85dc5114fc91 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:41.210508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1246/2494] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:42.061414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573faa4b-9291-49e4-aae8-c6bd9f197b06 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:42.062970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-573faa4b-9291-49e4-aae8-c6bd9f197b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:42.153201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573faa4b-9291-49e4-aae8-c6bd9f197b06 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:42.159506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb61940-db09-4f38-8024-8c7054367a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:42.160058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb61940-db09-4f38-8024-8c7054367a9d service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:42.160343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb61940-db09-4f38-8024-8c7054367a9d service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:42.160617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb61940-db09-4f38-8024-8c7054367a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:42.162657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5bb61940-db09-4f38-8024-8c7054367a9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:42.183865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb61940-db09-4f38-8024-8c7054367a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:42.189989 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb61940-db09-4f38-8024-8c7054367a9d service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:42.211962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1249/2495] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:51.206246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=48 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:52.204215 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:53.976657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1d68-79f1-43f6-a308-85dc5114fc91 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:53.985570 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1d68-79f1-43f6-a308-85dc5114fc91 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:53.989266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:53.989879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:53.990156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:53.990423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:53.992295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:54.062623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:54.064115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:54.075729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1247/2496] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:55.214863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb61940-db09-4f38-8024-8c7054367a9d service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:55.225138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb61940-db09-4f38-8024-8c7054367a9d service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:55.229730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:55.230406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:55.230693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:55.231333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:55.233603 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:55.322315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:55.323821 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:55.343787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1250/2497] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:00:57.241894 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:00:57.243480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:57.351503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd785380-6238-4e25-be25-d12b62fce7fb service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:00:57.357386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecf0a0-6ef6-4de8-b64a-72469c07e9a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:00:57.358031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecf0a0-6ef6-4de8-b64a-72469c07e9a1 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:00:57.358308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecf0a0-6ef6-4de8-b64a-72469c07e9a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:00:57.358577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecf0a0-6ef6-4de8-b64a-72469c07e9a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:00:57.360433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-27ecf0a0-6ef6-4de8-b64a-72469c07e9a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:00:57.372486 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecf0a0-6ef6-4de8-b64a-72469c07e9a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:00:57.374088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecf0a0-6ef6-4de8-b64a-72469c07e9a1 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:00:57.384665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1248/2498] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:00:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:00.261432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:00.263050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:00.283456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bafacf-61cf-4689-a448-ed7e739e1825 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:00.288239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:00.288914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:00.289198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:00.289481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] PATH_INFO: `/v3/users/d93f5d182474439bb6ea1d8b70f39b2b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:00.290665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93f5d182474439bb6ea1d8b70f39b2b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:00.292645 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:00.338816 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93f5d182474439bb6ea1d8b70f39b2b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.346186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93f5d182474439bb6ea1d8b70f39b2b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.358938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93f5d182474439bb6ea1d8b70f39b2b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.359602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93f5d182474439bb6ea1d8b70f39b2b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.366387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93f5d182474439bb6ea1d8b70f39b2b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.372329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1251/2499] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:00 2022] DELETE /identity/v3/users/d93f5d182474439bb6ea1d8b70f39b2b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:00.548675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecf0a0-6ef6-4de8-b64a-72469c07e9a1 service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:00.566924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecf0a0-6ef6-4de8-b64a-72469c07e9a1 service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:00.639657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:00.640306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:00.640585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:00.640859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] PATH_INFO: `/v3/projects/d312b027f97e482d82eea4bdd7bb3166` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:00.642035 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d312b027f97e482d82eea4bdd7bb3166)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:00.644120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:00.675438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:00.693550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd312b027f97e482d82eea4bdd7bb3166', 'request_id': 'req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.702957 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd312b027f97e482d82eea4bdd7bb3166', 'request_id': 'req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.709474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd312b027f97e482d82eea4bdd7bb3166', 'request_id': 'req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.721013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] The token cache is being invalidate because project d312b027f97e482d82eea4bdd7bb3166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:00.721342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.721964 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.723991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1249/2500] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:00 2022] DELETE /identity/v3/projects/d312b027f97e482d82eea4bdd7bb3166 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:00.727973 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:00.729713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:00.743537 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f23c3-a2a9-44bf-ba2c-e977cdd04bd6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:00.784708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:00.804769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:00.805423 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:00.805702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:00.805977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] PATH_INFO: `/v3/users/02048810ba0b466d9565b93c04e26faf` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:00.807181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02048810ba0b466d9565b93c04e26faf)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:00.809148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:00.863840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02048810ba0b466d9565b93c04e26faf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.872899 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02048810ba0b466d9565b93c04e26faf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.893492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02048810ba0b466d9565b93c04e26faf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.894381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02048810ba0b466d9565b93c04e26faf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.904323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02048810ba0b466d9565b93c04e26faf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:00.915299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1252/2501] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:00 2022] DELETE /identity/v3/users/02048810ba0b466d9565b93c04e26faf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:01.115254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:01.117710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:01.131869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e8b67-82d9-4300-97f2-0014d8d44d4c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:01.191864 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:01.192571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:01.192901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:01.193213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] PATH_INFO: `/v3/projects/c244c27591974a429fd176a8f520c1ed` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:01.194477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c244c27591974a429fd176a8f520c1ed)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:01.196545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:01.242710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c244c27591974a429fd176a8f520c1ed', 'request_id': 'req-b679ec80-ee16-4ebf-bbc6-e985863d6069'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:01.250098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c244c27591974a429fd176a8f520c1ed', 'request_id': 'req-b679ec80-ee16-4ebf-bbc6-e985863d6069'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:01.255580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c244c27591974a429fd176a8f520c1ed', 'request_id': 'req-b679ec80-ee16-4ebf-bbc6-e985863d6069'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:01.267322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] The token cache is being invalidate because project c244c27591974a429fd176a8f520c1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:01.267604 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:01.268268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:01.269775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1250/2502] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:01 2022] DELETE /identity/v3/projects/c244c27591974a429fd176a8f520c1ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:02.194357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:02.196473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:02.265091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb6c4-d684-403e-bb7a-622a48309788 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:02.312806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4804b7b-e360-49af-b33c-38f4514f5c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:02.313401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4804b7b-e360-49af-b33c-38f4514f5c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:02.313677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4804b7b-e360-49af-b33c-38f4514f5c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:02.313948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4804b7b-e360-49af-b33c-38f4514f5c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:02.315840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e4804b7b-e360-49af-b33c-38f4514f5c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:02.347578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:02.380384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4804b7b-e360-49af-b33c-38f4514f5c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:02.381829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4804b7b-e360-49af-b33c-38f4514f5c6e service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:02.393118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1253/2503] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:04.415701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:04.417194 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:04.435236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679ec80-ee16-4ebf-bbc6-e985863d6069 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:04.440001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:04.440666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:04.440949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:04.441224 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] PATH_INFO: `/v3/users/27ef532cf5e944548f2a2d82abd69fe1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:04.442410 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ef532cf5e944548f2a2d82abd69fe1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:04.444383 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:04.496695 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:04.505418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ef532cf5e944548f2a2d82abd69fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:04.528090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ef532cf5e944548f2a2d82abd69fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:04.529308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ef532cf5e944548f2a2d82abd69fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:04.542254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ef532cf5e944548f2a2d82abd69fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:04.543099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ef532cf5e944548f2a2d82abd69fe1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:04.566003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1251/2504] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:04 2022] DELETE /identity/v3/users/27ef532cf5e944548f2a2d82abd69fe1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:04.568574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581af803-8570-447a-a6ba-0578d651cfff None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:04.568574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581af803-8570-447a-a6ba-0578d651cfff None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:04.569164 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581af803-8570-447a-a6ba-0578d651cfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:04.599852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-581af803-8570-447a-a6ba-0578d651cfff None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:04.602720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-581af803-8570-447a-a6ba-0578d651cfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:04.681890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1254/2505] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:04.691670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:04.693083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:04.752219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fda34-b717-4c49-95c4-c1066f997894 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:04.756088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7732d0e-fcaa-474f-8271-2a91cd23c34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:04.756747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7732d0e-fcaa-474f-8271-2a91cd23c34b service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:04.757566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7732d0e-fcaa-474f-8271-2a91cd23c34b service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:04.757842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7732d0e-fcaa-474f-8271-2a91cd23c34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:04.768742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7732d0e-fcaa-474f-8271-2a91cd23c34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:04.770278 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7732d0e-fcaa-474f-8271-2a91cd23c34b service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:04.780735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1252/2506] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:05.212308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581af803-8570-447a-a6ba-0578d651cfff None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:05.214463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-581af803-8570-447a-a6ba-0578d651cfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:05.246931 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581af803-8570-447a-a6ba-0578d651cfff None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:05.264019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:05.264793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:05.265197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:05.265611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] PATH_INFO: `/v3/projects/f862b8836fdd4c7ab44273c8dc0a03ab` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:05.267109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f862b8836fdd4c7ab44273c8dc0a03ab)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:05.269164 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:05.330097 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f862b8836fdd4c7ab44273c8dc0a03ab', 'request_id': 'req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.339810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f862b8836fdd4c7ab44273c8dc0a03ab', 'request_id': 'req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.346475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f862b8836fdd4c7ab44273c8dc0a03ab', 'request_id': 'req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.358330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] The token cache is being invalidate because project f862b8836fdd4c7ab44273c8dc0a03ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:05.358521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.359165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.360759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1255/2507] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:05 2022] DELETE /identity/v3/projects/f862b8836fdd4c7ab44273c8dc0a03ab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:05.366957 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7732d0e-fcaa-474f-8271-2a91cd23c34b service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:05.379142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7732d0e-fcaa-474f-8271-2a91cd23c34b service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:05.452321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:05.453055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:05.453404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:05.453746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] PATH_INFO: `/v3/users/0f622ad2213849498127b132ce8847a3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:05.455586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f622ad2213849498127b132ce8847a3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:05.458358 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:05.516701 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f622ad2213849498127b132ce8847a3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.530584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:05.533869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f622ad2213849498127b132ce8847a3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.535452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f622ad2213849498127b132ce8847a3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.550465 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f622ad2213849498127b132ce8847a3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.551868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f622ad2213849498127b132ce8847a3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:05.572461 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1253/2508] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:05 2022] DELETE /identity/v3/users/0f622ad2213849498127b132ce8847a3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:05.791017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:05.792985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:05.831411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f9fd-ed71-43bf-847b-652bec2c10d8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:05.938481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:05.949054 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:05.949938 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:05.950147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:05.950543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] PATH_INFO: `/v3/users/df8fb928aa42413b9d03e83f46dd48bc` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:05.952062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8fb928aa42413b9d03e83f46dd48bc)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:05.954312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:05.975682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:05.977226 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:05.993387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d51d3b-471b-429b-9e42-ee5608db3cbc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:05.998436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:05.999128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:05.999418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:05.999693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] PATH_INFO: `/v3/projects/07be385333b84691901d7785594164f9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.001545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07be385333b84691901d7785594164f9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.003665 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.019185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8fb928aa42413b9d03e83f46dd48bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.028026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8fb928aa42413b9d03e83f46dd48bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.041290 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8fb928aa42413b9d03e83f46dd48bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.042017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8fb928aa42413b9d03e83f46dd48bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.049285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-22b6f2bf-aed6-41ab-aa86-c1d4326ec09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8fb928aa42413b9d03e83f46dd48bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.052675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07be385333b84691901d7785594164f9', 'request_id': 'req-77c7bd7a-589f-40a3-b2e4-00106f230b1e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.056089 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1256/2509] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:05 2022] DELETE /identity/v3/users/df8fb928aa42413b9d03e83f46dd48bc => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:06.068172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07be385333b84691901d7785594164f9', 'request_id': 'req-77c7bd7a-589f-40a3-b2e4-00106f230b1e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.077384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07be385333b84691901d7785594164f9', 'request_id': 'req-77c7bd7a-589f-40a3-b2e4-00106f230b1e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.088632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] The token cache is being invalidate because project 07be385333b84691901d7785594164f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:06.088923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.089633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77c7bd7a-589f-40a3-b2e4-00106f230b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.091246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1254/2510] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:05 2022] DELETE /identity/v3/projects/07be385333b84691901d7785594164f9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:06.096114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b63fe9-4fc4-4216-9780-d1a9c7dbaf9e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.096407 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b63fe9-4fc4-4216-9780-d1a9c7dbaf9e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.096678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b63fe9-4fc4-4216-9780-d1a9c7dbaf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.118138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b2b63fe9-4fc4-4216-9780-d1a9c7dbaf9e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:06.119420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b2b63fe9-4fc4-4216-9780-d1a9c7dbaf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:06.192462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1257/2511] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:06.200452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058bf43-992f-4f25-a30b-3a8d37f86480 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.200823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058bf43-992f-4f25-a30b-3a8d37f86480 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.201205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058bf43-992f-4f25-a30b-3a8d37f86480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.223654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3058bf43-992f-4f25-a30b-3a8d37f86480 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:06.224990 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3058bf43-992f-4f25-a30b-3a8d37f86480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:06.234015 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1255/2512] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:06.237057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b63fe9-4fc4-4216-9780-d1a9c7dbaf9e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.238020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058bf43-992f-4f25-a30b-3a8d37f86480 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.239012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b2b63fe9-4fc4-4216-9780-d1a9c7dbaf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:06.247989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058bf43-992f-4f25-a30b-3a8d37f86480 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.252455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b63fe9-4fc4-4216-9780-d1a9c7dbaf9e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.252919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce633b8-6455-4e92-8255-357d522fcc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.253574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce633b8-6455-4e92-8255-357d522fcc7a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.254246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce633b8-6455-4e92-8255-357d522fcc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.254246 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce633b8-6455-4e92-8255-357d522fcc7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.255051 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce633b8-6455-4e92-8255-357d522fcc7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:06.255366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce633b8-6455-4e92-8255-357d522fcc7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.257016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce633b8-6455-4e92-8255-357d522fcc7a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.271111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.271861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.272377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.272702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] PATH_INFO: `/v3/projects/1cabcb825ebe4430a7ffa759d5e53d2f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.274769 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1256/2513] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:01:06.275256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cabcb825ebe4430a7ffa759d5e53d2f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.275816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce633b8-6455-4e92-8255-357d522fcc7a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.277327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.285757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce633b8-6455-4e92-8255-357d522fcc7a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.291154 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce5624-9bb4-4ed1-8c1c-05cdeffc5e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.291763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce5624-9bb4-4ed1-8c1c-05cdeffc5e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.292042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce5624-9bb4-4ed1-8c1c-05cdeffc5e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.292311 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce5624-9bb4-4ed1-8c1c-05cdeffc5e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.292971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce5624-9bb4-4ed1-8c1c-05cdeffc5e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.295043 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce5624-9bb4-4ed1-8c1c-05cdeffc5e58 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.326535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1257/2514] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:06.330728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce5624-9bb4-4ed1-8c1c-05cdeffc5e58 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.333620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cabcb825ebe4430a7ffa759d5e53d2f', 'request_id': 'req-54a724d4-62fc-4f92-b70b-8e547cc6789e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.342741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cabcb825ebe4430a7ffa759d5e53d2f', 'request_id': 'req-54a724d4-62fc-4f92-b70b-8e547cc6789e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.348991 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cabcb825ebe4430a7ffa759d5e53d2f', 'request_id': 'req-54a724d4-62fc-4f92-b70b-8e547cc6789e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.350083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:06.363995 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] The token cache is being invalidate because project 1cabcb825ebe4430a7ffa759d5e53d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:06.364301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.364944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-54a724d4-62fc-4f92-b70b-8e547cc6789e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:06.366539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1258/2515] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:06 2022] DELETE /identity/v3/projects/1cabcb825ebe4430a7ffa759d5e53d2f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:06.371327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e23d-4635-487f-a7ef-47d783ba4821 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.371607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e23d-4635-487f-a7ef-47d783ba4821 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.371886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e23d-4635-487f-a7ef-47d783ba4821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.391471 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e629e23d-4635-487f-a7ef-47d783ba4821 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:06.393302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e629e23d-4635-487f-a7ef-47d783ba4821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:06.395607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce5624-9bb4-4ed1-8c1c-05cdeffc5e58 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.401045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c06e3-d6c7-4d59-bba6-92b4de58a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.401670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c06e3-d6c7-4d59-bba6-92b4de58a1ae admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.401972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c06e3-d6c7-4d59-bba6-92b4de58a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.402247 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c06e3-d6c7-4d59-bba6-92b4de58a1ae admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.402765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1259/2516] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:06.402926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c06e3-d6c7-4d59-bba6-92b4de58a1ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.404890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c06e3-d6c7-4d59-bba6-92b4de58a1ae admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.410213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24dae0-a288-4316-a7ea-ed1399263822 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.410500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24dae0-a288-4316-a7ea-ed1399263822 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.410774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24dae0-a288-4316-a7ea-ed1399263822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.431376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5d24dae0-a288-4316-a7ea-ed1399263822 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:06.434458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1258/2517] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:06.434585 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5d24dae0-a288-4316-a7ea-ed1399263822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:06.437772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c06e3-d6c7-4d59-bba6-92b4de58a1ae admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.439394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1a8c06e3-d6c7-4d59-bba6-92b4de58a1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:06.441263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1260/2518] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:06.445823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24dae0-a288-4316-a7ea-ed1399263822 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.452638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c06e3-d6c7-4d59-bba6-92b4de58a1ae admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.455045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24dae0-a288-4316-a7ea-ed1399263822 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.457886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e05f26-479b-4e82-979a-71dd1622e079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.458162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e05f26-479b-4e82-979a-71dd1622e079 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.458450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e05f26-479b-4e82-979a-71dd1622e079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.458743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e05f26-479b-4e82-979a-71dd1622e079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.459495 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e05f26-479b-4e82-979a-71dd1622e079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.459828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb0d4c-8331-4e57-bfa6-147b5979fa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.460996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb0d4c-8331-4e57-bfa6-147b5979fa4b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.461272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb0d4c-8331-4e57-bfa6-147b5979fa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.461545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb0d4c-8331-4e57-bfa6-147b5979fa4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.461709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e05f26-479b-4e82-979a-71dd1622e079 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.462240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb0d4c-8331-4e57-bfa6-147b5979fa4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:06.462545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb0d4c-8331-4e57-bfa6-147b5979fa4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.463948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=9,keystone:SELECT=85,keystone:INSERT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:06.464177 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb0d4c-8331-4e57-bfa6-147b5979fa4b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.473416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1259/2519] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:06.480718 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1261/2520] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:01:06.480880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e05f26-479b-4e82-979a-71dd1622e079 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.481645 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb0d4c-8331-4e57-bfa6-147b5979fa4b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.487651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e05f26-479b-4e82-979a-71dd1622e079 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.491168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb0d4c-8331-4e57-bfa6-147b5979fa4b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.492924 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dbf3c-8dff-4ba2-adc3-1f137edea552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.493678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dbf3c-8dff-4ba2-adc3-1f137edea552 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.494039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dbf3c-8dff-4ba2-adc3-1f137edea552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.494387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dbf3c-8dff-4ba2-adc3-1f137edea552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.495129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dbf3c-8dff-4ba2-adc3-1f137edea552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.496538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308b647-28d7-46e7-b3b3-86f83d5f099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.496758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dbf3c-8dff-4ba2-adc3-1f137edea552 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.497129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b647-28d7-46e7-b3b3-86f83d5f099e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.497410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b647-28d7-46e7-b3b3-86f83d5f099e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.497683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b647-28d7-46e7-b3b3-86f83d5f099e admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.498351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308b647-28d7-46e7-b3b3-86f83d5f099e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.500270 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308b647-28d7-46e7-b3b3-86f83d5f099e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.507533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1260/2521] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:06.511798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dbf3c-8dff-4ba2-adc3-1f137edea552 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.522431 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dbf3c-8dff-4ba2-adc3-1f137edea552 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.527678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df22e2-fde6-484c-8d7a-9d75136a688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.528174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1262/2522] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:06.531251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df22e2-fde6-484c-8d7a-9d75136a688e admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.531868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df22e2-fde6-484c-8d7a-9d75136a688e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.532147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df22e2-fde6-484c-8d7a-9d75136a688e admin admin] PATH_INFO: `/v3/projects/6278e4c3509741ccb4fb79428f19659d/users/9fd7e37b64af43d28d105534556f5d13/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.532615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308b647-28d7-46e7-b3b3-86f83d5f099e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.548168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df22e2-fde6-484c-8d7a-9d75136a688e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6278e4c3509741ccb4fb79428f19659d, user_id=9fd7e37b64af43d28d105534556f5d13, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.550842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df22e2-fde6-484c-8d7a-9d75136a688e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.565724 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1261/2523] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:06 2022] PUT /identity/v3/projects/6278e4c3509741ccb4fb79428f19659d/users/9fd7e37b64af43d28d105534556f5d13/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:06.577313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9f1c-8da5-41f0-9ba5-d8181cd3492f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.577621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9f1c-8da5-41f0-9ba5-d8181cd3492f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.577874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9f1c-8da5-41f0-9ba5-d8181cd3492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.596274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308b647-28d7-46e7-b3b3-86f83d5f099e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.609199 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-540b9f1c-8da5-41f0-9ba5-d8181cd3492f None None] MFA Rules not processed for user `9fd7e37b64af43d28d105534556f5d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:06.610429 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-540b9f1c-8da5-41f0-9ba5-d8181cd3492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:06.669736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427245-e003-41ed-85f2-1cdb1b7adf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.670637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427245-e003-41ed-85f2-1cdb1b7adf8a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.671250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427245-e003-41ed-85f2-1cdb1b7adf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.671752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427245-e003-41ed-85f2-1cdb1b7adf8a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.672725 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef427245-e003-41ed-85f2-1cdb1b7adf8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.674706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef427245-e003-41ed-85f2-1cdb1b7adf8a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.684451 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1262/2524] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:06.688693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9f1c-8da5-41f0-9ba5-d8181cd3492f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.702775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1263/2525] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:06.703098 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9f1c-8da5-41f0-9ba5-d8181cd3492f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.703637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427245-e003-41ed-85f2-1cdb1b7adf8a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.704632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f71a96-9e5a-4274-8b29-6dea9580d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.706052 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f71a96-9e5a-4274-8b29-6dea9580d4ed admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.706328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f71a96-9e5a-4274-8b29-6dea9580d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.706687 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f71a96-9e5a-4274-8b29-6dea9580d4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.707399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f71a96-9e5a-4274-8b29-6dea9580d4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.710618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f71a96-9e5a-4274-8b29-6dea9580d4ed admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.715016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427245-e003-41ed-85f2-1cdb1b7adf8a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.719973 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a40d2f-1b58-4fce-b907-4810999c3d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.720587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a40d2f-1b58-4fce-b907-4810999c3d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.720865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a40d2f-1b58-4fce-b907-4810999c3d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.721140 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a40d2f-1b58-4fce-b907-4810999c3d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.721970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a40d2f-1b58-4fce-b907-4810999c3d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.723755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a40d2f-1b58-4fce-b907-4810999c3d41 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.734870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1264/2526] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:06.739031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a40d2f-1b58-4fce-b907-4810999c3d41 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.743630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1263/2527] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:06.747810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f71a96-9e5a-4274-8b29-6dea9580d4ed admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.749521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a40d2f-1b58-4fce-b907-4810999c3d41 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.780085 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:06.810273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534b53-2850-4943-88d0-ae5f76f484ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.810962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534b53-2850-4943-88d0-ae5f76f484ed admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.811190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534b53-2850-4943-88d0-ae5f76f484ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.811464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534b53-2850-4943-88d0-ae5f76f484ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.812171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534b53-2850-4943-88d0-ae5f76f484ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.813780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534b53-2850-4943-88d0-ae5f76f484ed admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.814157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f71a96-9e5a-4274-8b29-6dea9580d4ed admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.819162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93110630-2988-4225-97e3-f1c18a4ac94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.819925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93110630-2988-4225-97e3-f1c18a4ac94f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.820207 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93110630-2988-4225-97e3-f1c18a4ac94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.820479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93110630-2988-4225-97e3-f1c18a4ac94f admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.821279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93110630-2988-4225-97e3-f1c18a4ac94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.823221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93110630-2988-4225-97e3-f1c18a4ac94f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.824321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1265/2528] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:06.828556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534b53-2850-4943-88d0-ae5f76f484ed admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.841097 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534b53-2850-4943-88d0-ae5f76f484ed admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.848767 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1264/2529] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:06.848929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2f27d-f0ba-4a86-9ac4-48bc9f1a3cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.848929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2f27d-f0ba-4a86-9ac4-48bc9f1a3cee admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.848929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2f27d-f0ba-4a86-9ac4-48bc9f1a3cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.848929 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2f27d-f0ba-4a86-9ac4-48bc9f1a3cee admin admin] PATH_INFO: `/v3/projects/b4c9a0c794ae48cc88b0a68e79ed4e5b/users/0cde7cc809d149759eef38149c72817d/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.849814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93110630-2988-4225-97e3-f1c18a4ac94f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.860738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93110630-2988-4225-97e3-f1c18a4ac94f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.863686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2f27d-f0ba-4a86-9ac4-48bc9f1a3cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c9a0c794ae48cc88b0a68e79ed4e5b, user_id=0cde7cc809d149759eef38149c72817d, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.865515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54d450-3058-4f2c-ab98-966945eb3f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.866133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54d450-3058-4f2c-ab98-966945eb3f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.866414 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2f27d-f0ba-4a86-9ac4-48bc9f1a3cee admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.866538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54d450-3058-4f2c-ab98-966945eb3f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.866698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54d450-3058-4f2c-ab98-966945eb3f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.867536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54d450-3058-4f2c-ab98-966945eb3f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.869146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54d450-3058-4f2c-ab98-966945eb3f8a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.879703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1265/2530] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:06.883915 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1266/2531] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:06 2022] PUT /identity/v3/projects/b4c9a0c794ae48cc88b0a68e79ed4e5b/users/0cde7cc809d149759eef38149c72817d/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:06.884676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54d450-3058-4f2c-ab98-966945eb3f8a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:06.894961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54d450-3058-4f2c-ab98-966945eb3f8a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:06.895184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d974c-876d-4caf-af75-3cb0960cc612 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.895542 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d974c-876d-4caf-af75-3cb0960cc612 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.895907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d974c-876d-4caf-af75-3cb0960cc612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.900611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:06.932596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-817d974c-876d-4caf-af75-3cb0960cc612 None None] MFA Rules not processed for user `0cde7cc809d149759eef38149c72817d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:06.934103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-817d974c-876d-4caf-af75-3cb0960cc612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:06.957828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a17d57-9b94-4aa0-80f2-7736af6fe6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:06.959025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a17d57-9b94-4aa0-80f2-7736af6fe6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:06.959370 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a17d57-9b94-4aa0-80f2-7736af6fe6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:06.959693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a17d57-9b94-4aa0-80f2-7736af6fe6d1 admin admin] PATH_INFO: `/v3/projects/1a35f7be1c6142ecac8f0a03caa0e5a5/users/ae2722eab52c40e4898d983f59c5809d/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:06.977212 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a17d57-9b94-4aa0-80f2-7736af6fe6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a35f7be1c6142ecac8f0a03caa0e5a5, user_id=ae2722eab52c40e4898d983f59c5809d, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:06.980436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a17d57-9b94-4aa0-80f2-7736af6fe6d1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:06.998925 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1266/2532] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:06 2022] PUT /identity/v3/projects/1a35f7be1c6142ecac8f0a03caa0e5a5/users/ae2722eab52c40e4898d983f59c5809d/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:07.003275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a17d57-9b94-4aa0-80f2-7736af6fe6d1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:07.013799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1267/2533] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:07.026053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d974c-876d-4caf-af75-3cb0960cc612 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:07.027606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-817d974c-876d-4caf-af75-3cb0960cc612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:07.078868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a17d57-9b94-4aa0-80f2-7736af6fe6d1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:07.084201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135f15-e4be-4022-a442-160e1a8f1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:07.084826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135f15-e4be-4022-a442-160e1a8f1962 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:07.085828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135f15-e4be-4022-a442-160e1a8f1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:07.086117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135f15-e4be-4022-a442-160e1a8f1962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:07.086849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135f15-e4be-4022-a442-160e1a8f1962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:07.088757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135f15-e4be-4022-a442-160e1a8f1962 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:07.102725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1267/2534] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:07.104044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135f15-e4be-4022-a442-160e1a8f1962 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:07.109526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d974c-876d-4caf-af75-3cb0960cc612 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:07.120080 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135f15-e4be-4022-a442-160e1a8f1962 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:07.128940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914a982-0ceb-4893-8958-e386702ea2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:07.129673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914a982-0ceb-4893-8958-e386702ea2a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:07.130067 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914a982-0ceb-4893-8958-e386702ea2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:07.130412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914a982-0ceb-4893-8958-e386702ea2a2 admin admin] PATH_INFO: `/v3/projects/1a35f7be1c6142ecac8f0a03caa0e5a5/users/ae2722eab52c40e4898d983f59c5809d/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:07.133190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914a982-0ceb-4893-8958-e386702ea2a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a35f7be1c6142ecac8f0a03caa0e5a5, user_id=ae2722eab52c40e4898d983f59c5809d, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:07.136165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914a982-0ceb-4893-8958-e386702ea2a2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:07.148875 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:07.151069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1268/2535] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:07 2022] PUT /identity/v3/projects/1a35f7be1c6142ecac8f0a03caa0e5a5/users/ae2722eab52c40e4898d983f59c5809d/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:07.161746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75d47-c26e-4050-9406-bd46359dcced None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:07.162034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75d47-c26e-4050-9406-bd46359dcced None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:07.162318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75d47-c26e-4050-9406-bd46359dcced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:07.189456 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b462df-3193-469b-a09e-641bf619cf13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:07.191335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b462df-3193-469b-a09e-641bf619cf13 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:07.191751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b462df-3193-469b-a09e-641bf619cf13 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:07.192084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b462df-3193-469b-a09e-641bf619cf13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:07.199394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bad75d47-c26e-4050-9406-bd46359dcced None None] MFA Rules not processed for user `ae2722eab52c40e4898d983f59c5809d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:07.200628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bad75d47-c26e-4050-9406-bd46359dcced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:07.267182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b462df-3193-469b-a09e-641bf619cf13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:07.268799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b462df-3193-469b-a09e-641bf619cf13 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:07.274561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:07.278778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1269/2536] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:07.279551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1268/2537] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:07.290670 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75d47-c26e-4050-9406-bd46359dcced None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:07.292282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bad75d47-c26e-4050-9406-bd46359dcced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:07.354250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75d47-c26e-4050-9406-bd46359dcced None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:07.358122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809b915-3964-400f-8c7a-8d259d3e05b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:07.358743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809b915-3964-400f-8c7a-8d259d3e05b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:07.359055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809b915-3964-400f-8c7a-8d259d3e05b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:07.359324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809b915-3964-400f-8c7a-8d259d3e05b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:07.369024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809b915-3964-400f-8c7a-8d259d3e05b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:07.370454 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809b915-3964-400f-8c7a-8d259d3e05b0 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:07.380008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1270/2538] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:07.449669 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b462df-3193-469b-a09e-641bf619cf13 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:07.462250 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b462df-3193-469b-a09e-641bf619cf13 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:07.527993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:07.528948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:07.528948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:07.529182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] PATH_INFO: `/v3/users/9fd7e37b64af43d28d105534556f5d13` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:07.531453 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd7e37b64af43d28d105534556f5d13)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:07.533477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:07.593690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd7e37b64af43d28d105534556f5d13'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:07.615412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd7e37b64af43d28d105534556f5d13'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:07.628963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:07.632722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd7e37b64af43d28d105534556f5d13'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:07.637521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd7e37b64af43d28d105534556f5d13'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:07.649879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd7e37b64af43d28d105534556f5d13'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:07.657300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1269/2539] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:07 2022] DELETE /identity/v3/users/9fd7e37b64af43d28d105534556f5d13 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:07.662669 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1519e2f-8c13-4fa5-a9fe-796f245efeb0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:07.663742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1519e2f-8c13-4fa5-a9fe-796f245efeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:07.663901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1519e2f-8c13-4fa5-a9fe-796f245efeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:07.683731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a1519e2f-8c13-4fa5-a9fe-796f245efeb0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:07.684939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1519e2f-8c13-4fa5-a9fe-796f245efeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:07.743970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1271/2540] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:07.753865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:07.755311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:07.812527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea411f2-a5da-48cb-9308-db1adbf2392b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:07.816256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61156774-6eee-46ab-89bd-a226972292bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:07.816866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61156774-6eee-46ab-89bd-a226972292bf service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:07.817143 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61156774-6eee-46ab-89bd-a226972292bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:07.817409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61156774-6eee-46ab-89bd-a226972292bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:07.826734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61156774-6eee-46ab-89bd-a226972292bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:07.828231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61156774-6eee-46ab-89bd-a226972292bf service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:07.838599 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1270/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:08.112542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1519e2f-8c13-4fa5-a9fe-796f245efeb0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:08.113981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1519e2f-8c13-4fa5-a9fe-796f245efeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:08.126286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1519e2f-8c13-4fa5-a9fe-796f245efeb0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:08.131318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:08.132060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:08.132291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:08.132648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] PATH_INFO: `/v3/projects/6278e4c3509741ccb4fb79428f19659d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:08.134363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6278e4c3509741ccb4fb79428f19659d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:08.136198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:08.183524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6278e4c3509741ccb4fb79428f19659d', 'request_id': 'req-f657ff74-d0f7-49f2-8e52-b34df0302b3c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.190630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6278e4c3509741ccb4fb79428f19659d', 'request_id': 'req-f657ff74-d0f7-49f2-8e52-b34df0302b3c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.196421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6278e4c3509741ccb4fb79428f19659d', 'request_id': 'req-f657ff74-d0f7-49f2-8e52-b34df0302b3c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.207438 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] The token cache is being invalidate because project 6278e4c3509741ccb4fb79428f19659d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:08.207727 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.208374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.210491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1272/2542] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:08 2022] DELETE /identity/v3/projects/6278e4c3509741ccb4fb79428f19659d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:08.214549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61156774-6eee-46ab-89bd-a226972292bf service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:08.224648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61156774-6eee-46ab-89bd-a226972292bf service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:08.283994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:08.284637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:08.284919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:08.285195 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] PATH_INFO: `/v3/users/ae2722eab52c40e4898d983f59c5809d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:08.286359 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2722eab52c40e4898d983f59c5809d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:08.289039 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:08.335775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2722eab52c40e4898d983f59c5809d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.343599 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2722eab52c40e4898d983f59c5809d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.357354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2722eab52c40e4898d983f59c5809d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.357952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2722eab52c40e4898d983f59c5809d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.364789 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8839eb2b-75a7-4996-a3d9-5b820b7c9a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2722eab52c40e4898d983f59c5809d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.370633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1271/2543] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:08 2022] DELETE /identity/v3/users/ae2722eab52c40e4898d983f59c5809d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:08.646420 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:08.648518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:08.664253 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657ff74-d0f7-49f2-8e52-b34df0302b3c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:08.694174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:08.730316 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:08.730992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:08.731273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:08.731545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] PATH_INFO: `/v3/projects/1a35f7be1c6142ecac8f0a03caa0e5a5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:08.732717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a35f7be1c6142ecac8f0a03caa0e5a5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:08.734962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:08.785014 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a35f7be1c6142ecac8f0a03caa0e5a5', 'request_id': 'req-9f821b83-55eb-4e4b-95f1-7430c72235ba'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.792846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a35f7be1c6142ecac8f0a03caa0e5a5', 'request_id': 'req-9f821b83-55eb-4e4b-95f1-7430c72235ba'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.798633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a35f7be1c6142ecac8f0a03caa0e5a5', 'request_id': 'req-9f821b83-55eb-4e4b-95f1-7430c72235ba'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.810972 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] The token cache is being invalidate because project 1a35f7be1c6142ecac8f0a03caa0e5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:08.811271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.811915 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f821b83-55eb-4e4b-95f1-7430c72235ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:08.813442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1273/2544] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:08 2022] DELETE /identity/v3/projects/1a35f7be1c6142ecac8f0a03caa0e5a5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:08.818683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf859b-52f9-49f5-975e-0def5d59e4b8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:08.819257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf859b-52f9-49f5-975e-0def5d59e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:08.819358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf859b-52f9-49f5-975e-0def5d59e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:08.843315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2fbf859b-52f9-49f5-975e-0def5d59e4b8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:08.844781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2fbf859b-52f9-49f5-975e-0def5d59e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:08.850204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:08.926091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1272/2545] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:08.927873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c143a-d802-46f6-bfdd-6dacce004900 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:08.928149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c143a-d802-46f6-bfdd-6dacce004900 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:08.928427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c143a-d802-46f6-bfdd-6dacce004900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:08.950596 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-350c143a-d802-46f6-bfdd-6dacce004900 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:08.951892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-350c143a-d802-46f6-bfdd-6dacce004900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:08.960744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1274/2546] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:08.968202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf859b-52f9-49f5-975e-0def5d59e4b8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:08.978763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf859b-52f9-49f5-975e-0def5d59e4b8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:08.985068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f38095-b074-432e-8e7c-ef9c2bdfd795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:08.985692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f38095-b074-432e-8e7c-ef9c2bdfd795 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:08.985974 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f38095-b074-432e-8e7c-ef9c2bdfd795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:08.986246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f38095-b074-432e-8e7c-ef9c2bdfd795 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:08.986992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f38095-b074-432e-8e7c-ef9c2bdfd795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:08.987302 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f38095-b074-432e-8e7c-ef9c2bdfd795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:08.988920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f38095-b074-432e-8e7c-ef9c2bdfd795 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.002972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1273/2547] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:09.006509 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c143a-d802-46f6-bfdd-6dacce004900 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.016930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c143a-d802-46f6-bfdd-6dacce004900 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.021732 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed9f4a-373f-4547-a8d7-9657e5f9e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.022473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed9f4a-373f-4547-a8d7-9657e5f9e576 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.022795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed9f4a-373f-4547-a8d7-9657e5f9e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.023107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed9f4a-373f-4547-a8d7-9657e5f9e576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.023901 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed9f4a-373f-4547-a8d7-9657e5f9e576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.025806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed9f4a-373f-4547-a8d7-9657e5f9e576 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.059783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1275/2548] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:09 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:09.060927 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f38095-b074-432e-8e7c-ef9c2bdfd795 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.071907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f38095-b074-432e-8e7c-ef9c2bdfd795 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.128543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270a126-2bd8-4738-8b4b-c509e9d07eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.129341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270a126-2bd8-4738-8b4b-c509e9d07eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.129624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270a126-2bd8-4738-8b4b-c509e9d07eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.129896 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270a126-2bd8-4738-8b4b-c509e9d07eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.130555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270a126-2bd8-4738-8b4b-c509e9d07eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.133288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270a126-2bd8-4738-8b4b-c509e9d07eb3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.153538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1274/2549] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:09 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:09.157721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed9f4a-373f-4547-a8d7-9657e5f9e576 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.168733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed9f4a-373f-4547-a8d7-9657e5f9e576 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.173327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26820d-eb40-431d-9d77-55eead1f2823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.174178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26820d-eb40-431d-9d77-55eead1f2823 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.174302 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26820d-eb40-431d-9d77-55eead1f2823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.174485 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26820d-eb40-431d-9d77-55eead1f2823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.175219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26820d-eb40-431d-9d77-55eead1f2823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.176857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26820d-eb40-431d-9d77-55eead1f2823 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.187389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1276/2550] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:09.191349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270a126-2bd8-4738-8b4b-c509e9d07eb3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.201295 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270a126-2bd8-4738-8b4b-c509e9d07eb3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.205900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679d4a0-3ae4-4f5f-a855-f2c46f17dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.206497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679d4a0-3ae4-4f5f-a855-f2c46f17dc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.206800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679d4a0-3ae4-4f5f-a855-f2c46f17dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.207096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679d4a0-3ae4-4f5f-a855-f2c46f17dc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.207786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679d4a0-3ae4-4f5f-a855-f2c46f17dc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.209371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679d4a0-3ae4-4f5f-a855-f2c46f17dc27 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.219267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1275/2551] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:09.223589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26820d-eb40-431d-9d77-55eead1f2823 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.234135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26820d-eb40-431d-9d77-55eead1f2823 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.238830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a2b28-8a49-4a63-9c6c-a6c23d94d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.239516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a2b28-8a49-4a63-9c6c-a6c23d94d6db admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.239798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a2b28-8a49-4a63-9c6c-a6c23d94d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.240075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a2b28-8a49-4a63-9c6c-a6c23d94d6db admin admin] PATH_INFO: `/v3/projects/34b5c90e50084444b8b8f4a78709f3dd/users/1b5a0c316f4848388fac961ae6e9ae00/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.255633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a2b28-8a49-4a63-9c6c-a6c23d94d6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b5c90e50084444b8b8f4a78709f3dd, user_id=1b5a0c316f4848388fac961ae6e9ae00, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.257942 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a2b28-8a49-4a63-9c6c-a6c23d94d6db admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.271648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1277/2552] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:09 2022] PUT /identity/v3/projects/34b5c90e50084444b8b8f4a78709f3dd/users/1b5a0c316f4848388fac961ae6e9ae00/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:09.282610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaede5-08db-43af-9a54-eae538fe8795 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.282905 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaede5-08db-43af-9a54-eae538fe8795 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.283199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaede5-08db-43af-9a54-eae538fe8795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.311532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3edaede5-08db-43af-9a54-eae538fe8795 None None] MFA Rules not processed for user `1b5a0c316f4848388fac961ae6e9ae00`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:09.312725 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3edaede5-08db-43af-9a54-eae538fe8795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:09.380564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1276/2553] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:09.385102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a2b28-8a49-4a63-9c6c-a6c23d94d6db admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.442175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:09.454752 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a2b28-8a49-4a63-9c6c-a6c23d94d6db admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.459707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e71a7-065b-4e0c-b53f-6a937a180c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.460326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e71a7-065b-4e0c-b53f-6a937a180c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.460607 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e71a7-065b-4e0c-b53f-6a937a180c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.460881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e71a7-065b-4e0c-b53f-6a937a180c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.462082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e71a7-065b-4e0c-b53f-6a937a180c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.464045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e71a7-065b-4e0c-b53f-6a937a180c02 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.490646 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1278/2554] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:09 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:09.495014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaede5-08db-43af-9a54-eae538fe8795 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.501738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:09.506410 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaede5-08db-43af-9a54-eae538fe8795 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.563479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dcba4-e4f8-4e53-96cd-7fb95cc7c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.564099 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dcba4-e4f8-4e53-96cd-7fb95cc7c7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.564379 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dcba4-e4f8-4e53-96cd-7fb95cc7c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.564660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dcba4-e4f8-4e53-96cd-7fb95cc7c7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.565334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dcba4-e4f8-4e53-96cd-7fb95cc7c7f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.567298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dcba4-e4f8-4e53-96cd-7fb95cc7c7f1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.588300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1277/2555] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:09 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:09.592472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e71a7-065b-4e0c-b53f-6a937a180c02 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.603658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e71a7-065b-4e0c-b53f-6a937a180c02 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.608370 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a1ac0-9b70-4937-b14f-17ea53ace233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.608970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a1ac0-9b70-4937-b14f-17ea53ace233 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.609245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a1ac0-9b70-4937-b14f-17ea53ace233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.609515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a1ac0-9b70-4937-b14f-17ea53ace233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.610205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a1ac0-9b70-4937-b14f-17ea53ace233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.611826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a1ac0-9b70-4937-b14f-17ea53ace233 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.622422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1279/2556] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:09.626740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dcba4-e4f8-4e53-96cd-7fb95cc7c7f1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.637735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dcba4-e4f8-4e53-96cd-7fb95cc7c7f1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.642384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc39fc-e5cb-4213-b811-d70319259b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.643072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc39fc-e5cb-4213-b811-d70319259b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.643349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc39fc-e5cb-4213-b811-d70319259b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.643618 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc39fc-e5cb-4213-b811-d70319259b28 admin admin] PATH_INFO: `/v3/projects/38cf017cf8ff499d8f0ad59dc73cc387/users/b6d719a7ab034f638f926cd733b8791c/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.661083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc39fc-e5cb-4213-b811-d70319259b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cf017cf8ff499d8f0ad59dc73cc387, user_id=b6d719a7ab034f638f926cd733b8791c, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.667611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc39fc-e5cb-4213-b811-d70319259b28 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.680534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1278/2557] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:09 2022] PUT /identity/v3/projects/38cf017cf8ff499d8f0ad59dc73cc387/users/b6d719a7ab034f638f926cd733b8791c/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:09.684518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a1ac0-9b70-4937-b14f-17ea53ace233 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.694432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a1ac0-9b70-4937-b14f-17ea53ace233 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.749708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611bbe0-c9cf-45e0-9fc5-885d83510d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.750314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bbe0-c9cf-45e0-9fc5-885d83510d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.750591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bbe0-c9cf-45e0-9fc5-885d83510d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.750861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bbe0-c9cf-45e0-9fc5-885d83510d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.751581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611bbe0-c9cf-45e0-9fc5-885d83510d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.753162 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611bbe0-c9cf-45e0-9fc5-885d83510d21 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.762576 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1280/2558] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:09.766846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc39fc-e5cb-4213-b811-d70319259b28 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.777667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc39fc-e5cb-4213-b811-d70319259b28 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.782367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dffb3-b35d-4f2d-94d4-cc725f71f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.783061 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dffb3-b35d-4f2d-94d4-cc725f71f32b admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.783346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dffb3-b35d-4f2d-94d4-cc725f71f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.783622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dffb3-b35d-4f2d-94d4-cc725f71f32b admin admin] PATH_INFO: `/v3/projects/38cf017cf8ff499d8f0ad59dc73cc387/users/b6d719a7ab034f638f926cd733b8791c/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.785587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dffb3-b35d-4f2d-94d4-cc725f71f32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cf017cf8ff499d8f0ad59dc73cc387, user_id=b6d719a7ab034f638f926cd733b8791c, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:09.788314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dffb3-b35d-4f2d-94d4-cc725f71f32b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:09.799288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1279/2559] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:09 2022] PUT /identity/v3/projects/38cf017cf8ff499d8f0ad59dc73cc387/users/b6d719a7ab034f638f926cd733b8791c/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:09.809764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35899b7a-cd7f-4a6a-a741-83f8f524a6b6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.809764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35899b7a-cd7f-4a6a-a741-83f8f524a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.810263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35899b7a-cd7f-4a6a-a741-83f8f524a6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.842557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-35899b7a-cd7f-4a6a-a741-83f8f524a6b6 None None] MFA Rules not processed for user `b6d719a7ab034f638f926cd733b8791c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:09.843824 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-35899b7a-cd7f-4a6a-a741-83f8f524a6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:09.914024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1281/2560] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:09.926043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dffb3-b35d-4f2d-94d4-cc725f71f32b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:09.927850 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-680dffb3-b35d-4f2d-94d4-cc725f71f32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:09.985975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dffb3-b35d-4f2d-94d4-cc725f71f32b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:09.989504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d71e9a-cd26-43aa-a85b-1fceb7ba87e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:09.990117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d71e9a-cd26-43aa-a85b-1fceb7ba87e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:09.990401 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d71e9a-cd26-43aa-a85b-1fceb7ba87e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:09.990678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d71e9a-cd26-43aa-a85b-1fceb7ba87e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:09.999717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d71e9a-cd26-43aa-a85b-1fceb7ba87e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:10.001157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d71e9a-cd26-43aa-a85b-1fceb7ba87e6 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:10.011686 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1280/2561] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:01:10.325363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35899b7a-cd7f-4a6a-a741-83f8f524a6b6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:10.334851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35899b7a-cd7f-4a6a-a741-83f8f524a6b6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:10.340388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24133382-38cb-4e18-a74d-94e933f85439 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d719a7ab034f638f926cd733b8791c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38cf017cf8ff499d8f0ad59dc73cc387', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:10.341017 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24133382-38cb-4e18-a74d-94e933f85439 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:10.341300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24133382-38cb-4e18-a74d-94e933f85439 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:10.341572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24133382-38cb-4e18-a74d-94e933f85439 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:10.342279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24133382-38cb-4e18-a74d-94e933f85439 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:10.342584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24133382-38cb-4e18-a74d-94e933f85439 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:10.344221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24133382-38cb-4e18-a74d-94e933f85439 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:10.355986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1282/2562] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:10.360107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d71e9a-cd26-43aa-a85b-1fceb7ba87e6 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:10.369835 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d71e9a-cd26-43aa-a85b-1fceb7ba87e6 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:10.374454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e8e7-d421-47a7-8088-314838192614 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d719a7ab034f638f926cd733b8791c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38cf017cf8ff499d8f0ad59dc73cc387', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:10.375095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e8e7-d421-47a7-8088-314838192614 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:10.375385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e8e7-d421-47a7-8088-314838192614 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:10.375663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e8e7-d421-47a7-8088-314838192614 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:10.376334 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e8e7-d421-47a7-8088-314838192614 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:10.378251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e8e7-d421-47a7-8088-314838192614 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:10.405138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1281/2563] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:10 2022] POST /identity/v3/projects => generated 353 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:10.409223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24133382-38cb-4e18-a74d-94e933f85439 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:10.419318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24133382-38cb-4e18-a74d-94e933f85439 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:10.454126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:10.479306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d719a7ab034f638f926cd733b8791c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38cf017cf8ff499d8f0ad59dc73cc387', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:10.479922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:10.480201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:10.480470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:10.481160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:10.481462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:10.483058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:10.496335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1283/2564] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:10.532756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e8e7-d421-47a7-8088-314838192614 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:10.543236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e8e7-d421-47a7-8088-314838192614 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:10.547861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d719a7ab034f638f926cd733b8791c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38cf017cf8ff499d8f0ad59dc73cc387', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:10.548499 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:10.548786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:10.549064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] PATH_INFO: `/v3/projects/b8e0c6103ed24afda9cba25c0c267890` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:10.550235 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8e0c6103ed24afda9cba25c0c267890)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:10.552193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:10.587650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:10.602584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e0c6103ed24afda9cba25c0c267890', 'request_id': 'req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:10.609700 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e0c6103ed24afda9cba25c0c267890', 'request_id': 'req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:10.615329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e0c6103ed24afda9cba25c0c267890', 'request_id': 'req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:10.627550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] The token cache is being invalidate because project b8e0c6103ed24afda9cba25c0c267890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:10.627840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:10.628494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9669ea0a-c76e-4ead-9677-fe42bcafe7b4 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:10.630029 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1282/2565] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:10 2022] DELETE /identity/v3/projects/b8e0c6103ed24afda9cba25c0c267890 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:10.822000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:10.824030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:11.034751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617996e-925c-4fd1-a89d-77584a263c19 tempest-VolumeQuotaClassesTest-1417015435 tempest-VolumeQuotaClassesTest-1417015435-project-admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:11.089073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:11.089720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:11.090003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:11.090272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] PATH_INFO: `/v3/users/1b5a0c316f4848388fac961ae6e9ae00` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:11.091467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5a0c316f4848388fac961ae6e9ae00)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:11.093379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:11.147372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5a0c316f4848388fac961ae6e9ae00'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.159638 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5a0c316f4848388fac961ae6e9ae00'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.160335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5a0c316f4848388fac961ae6e9ae00'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.168749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5a0c316f4848388fac961ae6e9ae00'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.169365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5a0c316f4848388fac961ae6e9ae00'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.174787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:11.184423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1284/2566] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:10 2022] DELETE /identity/v3/users/1b5a0c316f4848388fac961ae6e9ae00 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:11.188944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244455a-60bd-42f4-91ef-38d47e8eaf07 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:11.189460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244455a-60bd-42f4-91ef-38d47e8eaf07 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:11.189460 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244455a-60bd-42f4-91ef-38d47e8eaf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:11.208481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4244455a-60bd-42f4-91ef-38d47e8eaf07 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:11.209697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4244455a-60bd-42f4-91ef-38d47e8eaf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:11.269716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1283/2567] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:11.280512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:11.281958 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:11.339851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2b332-a0a4-453f-9bd7-09c0874f546e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:11.343602 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501644ef-2189-411f-817f-bba8254f9e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:11.344223 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501644ef-2189-411f-817f-bba8254f9e9b service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:11.344505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501644ef-2189-411f-817f-bba8254f9e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:11.344779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501644ef-2189-411f-817f-bba8254f9e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:11.354667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501644ef-2189-411f-817f-bba8254f9e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:11.356126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501644ef-2189-411f-817f-bba8254f9e9b service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:11.365457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1285/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:11.642999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244455a-60bd-42f4-91ef-38d47e8eaf07 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:11.644467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4244455a-60bd-42f4-91ef-38d47e8eaf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:11.659671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244455a-60bd-42f4-91ef-38d47e8eaf07 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:11.665301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:11.665965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:11.666853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:11.667326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] PATH_INFO: `/v3/projects/34b5c90e50084444b8b8f4a78709f3dd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:11.668641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b5c90e50084444b8b8f4a78709f3dd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:11.670622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:11.719268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b5c90e50084444b8b8f4a78709f3dd', 'request_id': 'req-8537b9a1-968b-4f2e-a339-af90dabe0ab7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.728505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b5c90e50084444b8b8f4a78709f3dd', 'request_id': 'req-8537b9a1-968b-4f2e-a339-af90dabe0ab7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.734385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b5c90e50084444b8b8f4a78709f3dd', 'request_id': 'req-8537b9a1-968b-4f2e-a339-af90dabe0ab7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.746643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] The token cache is being invalidate because project 34b5c90e50084444b8b8f4a78709f3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:11.746977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.747642 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.749193 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1284/2569] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:11 2022] DELETE /identity/v3/projects/34b5c90e50084444b8b8f4a78709f3dd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:11.753225 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501644ef-2189-411f-817f-bba8254f9e9b service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:11.763475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501644ef-2189-411f-817f-bba8254f9e9b service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:11.818796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:11.819476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:11.819751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:11.820018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] PATH_INFO: `/v3/users/b6d719a7ab034f638f926cd733b8791c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:11.821859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d719a7ab034f638f926cd733b8791c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:11.823868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:11.874689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d719a7ab034f638f926cd733b8791c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.887826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d719a7ab034f638f926cd733b8791c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.888498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d719a7ab034f638f926cd733b8791c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.896069 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d719a7ab034f638f926cd733b8791c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.896766 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-53b31905-3980-402d-91c8-5434afaff12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d719a7ab034f638f926cd733b8791c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:11.909102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1286/2570] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:11 2022] DELETE /identity/v3/users/b6d719a7ab034f638f926cd733b8791c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:12.204960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:12.207107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:12.222141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537b9a1-968b-4f2e-a339-af90dabe0ab7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:12.269949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:12.287014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:12.287697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.287981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.288288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] PATH_INFO: `/v3/projects/38cf017cf8ff499d8f0ad59dc73cc387` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.290055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38cf017cf8ff499d8f0ad59dc73cc387)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:12.292051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:12.354590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38cf017cf8ff499d8f0ad59dc73cc387', 'request_id': 'req-506ac226-10eb-4428-a5c5-6a19e8c67174'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:12.362179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38cf017cf8ff499d8f0ad59dc73cc387', 'request_id': 'req-506ac226-10eb-4428-a5c5-6a19e8c67174'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:12.368717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38cf017cf8ff499d8f0ad59dc73cc387', 'request_id': 'req-506ac226-10eb-4428-a5c5-6a19e8c67174'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:12.379826 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] The token cache is being invalidate because project 38cf017cf8ff499d8f0ad59dc73cc387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:12.380113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:12.380767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-506ac226-10eb-4428-a5c5-6a19e8c67174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:12.382300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1285/2571] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:12 2022] DELETE /identity/v3/projects/38cf017cf8ff499d8f0ad59dc73cc387 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:12.387342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b9e5-2a7a-4829-bc65-f6f6a3047c30 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.387637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b9e5-2a7a-4829-bc65-f6f6a3047c30 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.387912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b9e5-2a7a-4829-bc65-f6f6a3047c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.407412 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1ca7b9e5-2a7a-4829-bc65-f6f6a3047c30 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:12.408546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1ca7b9e5-2a7a-4829-bc65-f6f6a3047c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:12.421125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:12.475439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1287/2572] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:12.483847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af250d0e-dd09-4cb7-8368-35ecdc99da31 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.484138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af250d0e-dd09-4cb7-8368-35ecdc99da31 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.484432 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af250d0e-dd09-4cb7-8368-35ecdc99da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.504222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-af250d0e-dd09-4cb7-8368-35ecdc99da31 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:12.505433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-af250d0e-dd09-4cb7-8368-35ecdc99da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:12.513323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1286/2573] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:12.517764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b9e5-2a7a-4829-bc65-f6f6a3047c30 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:12.527970 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b9e5-2a7a-4829-bc65-f6f6a3047c30 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:12.532685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0bab1-2e7f-45d3-9af3-82de4b110933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:12.533289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0bab1-2e7f-45d3-9af3-82de4b110933 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.533569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0bab1-2e7f-45d3-9af3-82de4b110933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.533845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0bab1-2e7f-45d3-9af3-82de4b110933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.534538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0bab1-2e7f-45d3-9af3-82de4b110933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:12.534842 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0bab1-2e7f-45d3-9af3-82de4b110933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:12.536500 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0bab1-2e7f-45d3-9af3-82de4b110933 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:12.548709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1288/2574] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:12.553157 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af250d0e-dd09-4cb7-8368-35ecdc99da31 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:12.562506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af250d0e-dd09-4cb7-8368-35ecdc99da31 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:12.569141 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7b3f6-0684-4f20-8bf0-7ed6d41bccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:12.569793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b3f6-0684-4f20-8bf0-7ed6d41bccf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.570072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b3f6-0684-4f20-8bf0-7ed6d41bccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.570346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b3f6-0684-4f20-8bf0-7ed6d41bccf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.571053 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7b3f6-0684-4f20-8bf0-7ed6d41bccf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:12.573045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7b3f6-0684-4f20-8bf0-7ed6d41bccf9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:12.601535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1287/2575] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:12 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:12.606839 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0bab1-2e7f-45d3-9af3-82de4b110933 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:12.617157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0bab1-2e7f-45d3-9af3-82de4b110933 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:12.675803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12d5d-dc58-49bc-8671-178056165118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:12.676273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12d5d-dc58-49bc-8671-178056165118 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.676581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12d5d-dc58-49bc-8671-178056165118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.676808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12d5d-dc58-49bc-8671-178056165118 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.677488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f12d5d-dc58-49bc-8671-178056165118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:12.679470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f12d5d-dc58-49bc-8671-178056165118 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:12.701011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1289/2576] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:12 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:12.705133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7b3f6-0684-4f20-8bf0-7ed6d41bccf9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:12.716839 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7b3f6-0684-4f20-8bf0-7ed6d41bccf9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:12.722045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa452d-7e44-4fa7-8602-259bae0f1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:12.723000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa452d-7e44-4fa7-8602-259bae0f1c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.723286 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa452d-7e44-4fa7-8602-259bae0f1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.723558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa452d-7e44-4fa7-8602-259bae0f1c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.724251 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa452d-7e44-4fa7-8602-259bae0f1c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:12.725896 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa452d-7e44-4fa7-8602-259bae0f1c69 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:12.736995 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1288/2577] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:12.741040 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12d5d-dc58-49bc-8671-178056165118 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:12.751415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12d5d-dc58-49bc-8671-178056165118 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:12.756185 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b050f-563f-4f4a-b2af-3a89d4278421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:12.756804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b050f-563f-4f4a-b2af-3a89d4278421 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.757073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b050f-563f-4f4a-b2af-3a89d4278421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.757340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b050f-563f-4f4a-b2af-3a89d4278421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.758044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b050f-563f-4f4a-b2af-3a89d4278421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:12.759673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b050f-563f-4f4a-b2af-3a89d4278421 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:12.769920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1290/2578] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:12.775107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa452d-7e44-4fa7-8602-259bae0f1c69 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:12.785780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa452d-7e44-4fa7-8602-259bae0f1c69 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:12.791776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d8ced-e9dd-4f02-96fa-cb12f8799558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:12.792568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d8ced-e9dd-4f02-96fa-cb12f8799558 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.792856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d8ced-e9dd-4f02-96fa-cb12f8799558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.793162 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d8ced-e9dd-4f02-96fa-cb12f8799558 admin admin] PATH_INFO: `/v3/projects/9ecf03da60d74c199d70701fb6455ac9/users/51a36e3353a74a229ac76c6e626d9e2f/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.809835 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d8ced-e9dd-4f02-96fa-cb12f8799558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ecf03da60d74c199d70701fb6455ac9, user_id=51a36e3353a74a229ac76c6e626d9e2f, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:12.812807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d8ced-e9dd-4f02-96fa-cb12f8799558 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:12.826752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1289/2579] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:12 2022] PUT /identity/v3/projects/9ecf03da60d74c199d70701fb6455ac9/users/51a36e3353a74a229ac76c6e626d9e2f/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:12.897874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1d17d-4d0d-433f-b850-0af123d2d2ed None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:12.898466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1d17d-4d0d-433f-b850-0af123d2d2ed None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:12.898466 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1d17d-4d0d-433f-b850-0af123d2d2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:12.927389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-30a1d17d-4d0d-433f-b850-0af123d2d2ed None None] MFA Rules not processed for user `51a36e3353a74a229ac76c6e626d9e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:12.928542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-30a1d17d-4d0d-433f-b850-0af123d2d2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:12.996849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1291/2580] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:13.001660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d8ced-e9dd-4f02-96fa-cb12f8799558 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:13.062798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d8ced-e9dd-4f02-96fa-cb12f8799558 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:13.067567 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902195a-495d-42b7-bfcd-9823fa139f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:13.068191 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902195a-495d-42b7-bfcd-9823fa139f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:13.068469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902195a-495d-42b7-bfcd-9823fa139f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:13.068745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902195a-495d-42b7-bfcd-9823fa139f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:13.069406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902195a-495d-42b7-bfcd-9823fa139f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:13.071861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902195a-495d-42b7-bfcd-9823fa139f86 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:13.087597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:13.102352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1290/2581] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:13 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:13.106571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1d17d-4d0d-433f-b850-0af123d2d2ed None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:13.117220 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1d17d-4d0d-433f-b850-0af123d2d2ed None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:13.126127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:13.178432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857b8e6-4650-4a4b-9ed6-34d6f74443f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:13.179016 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b8e6-4650-4a4b-9ed6-34d6f74443f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:13.179298 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b8e6-4650-4a4b-9ed6-34d6f74443f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:13.179568 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b8e6-4650-4a4b-9ed6-34d6f74443f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:13.180266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857b8e6-4650-4a4b-9ed6-34d6f74443f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:13.182254 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857b8e6-4650-4a4b-9ed6-34d6f74443f7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:13.207710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1292/2582] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:13 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:13.212586 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902195a-495d-42b7-bfcd-9823fa139f86 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:13.224007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902195a-495d-42b7-bfcd-9823fa139f86 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:13.229329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07187d0-34a9-4ddd-97d3-b62596f4af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:13.230041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07187d0-34a9-4ddd-97d3-b62596f4af3d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:13.230332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07187d0-34a9-4ddd-97d3-b62596f4af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:13.230607 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07187d0-34a9-4ddd-97d3-b62596f4af3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:13.231376 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07187d0-34a9-4ddd-97d3-b62596f4af3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:13.233000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07187d0-34a9-4ddd-97d3-b62596f4af3d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:13.246278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1291/2583] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:13.254543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857b8e6-4650-4a4b-9ed6-34d6f74443f7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:13.265891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857b8e6-4650-4a4b-9ed6-34d6f74443f7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:13.270588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752c680-5bb7-490f-ad73-93d01a99a76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:13.271289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752c680-5bb7-490f-ad73-93d01a99a76e admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:13.271571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752c680-5bb7-490f-ad73-93d01a99a76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:13.271841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752c680-5bb7-490f-ad73-93d01a99a76e admin admin] PATH_INFO: `/v3/projects/c4a10f45decf4ca99c94951ef46a089f/users/071cd7a512064adc8c6721eab5920c5b/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:13.286502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752c680-5bb7-490f-ad73-93d01a99a76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a10f45decf4ca99c94951ef46a089f, user_id=071cd7a512064adc8c6721eab5920c5b, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:13.289190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752c680-5bb7-490f-ad73-93d01a99a76e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:13.302688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1293/2584] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:13 2022] PUT /identity/v3/projects/c4a10f45decf4ca99c94951ef46a089f/users/071cd7a512064adc8c6721eab5920c5b/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:13.307280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07187d0-34a9-4ddd-97d3-b62596f4af3d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:13.317312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07187d0-34a9-4ddd-97d3-b62596f4af3d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:13.374260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04519c85-c915-4cea-be0d-bdfbed282373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:13.374870 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519c85-c915-4cea-be0d-bdfbed282373 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:13.375185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519c85-c915-4cea-be0d-bdfbed282373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:13.375462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519c85-c915-4cea-be0d-bdfbed282373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:13.376153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04519c85-c915-4cea-be0d-bdfbed282373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:13.377754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04519c85-c915-4cea-be0d-bdfbed282373 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:13.388075 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1292/2585] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:13.392340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752c680-5bb7-490f-ad73-93d01a99a76e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:13.402751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752c680-5bb7-490f-ad73-93d01a99a76e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:13.407612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5074-e813-4a15-a38c-f480771daeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:13.408263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5074-e813-4a15-a38c-f480771daeed admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:13.408537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5074-e813-4a15-a38c-f480771daeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:13.408804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5074-e813-4a15-a38c-f480771daeed admin admin] PATH_INFO: `/v3/projects/c4a10f45decf4ca99c94951ef46a089f/users/071cd7a512064adc8c6721eab5920c5b/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:13.410758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d5074-e813-4a15-a38c-f480771daeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a10f45decf4ca99c94951ef46a089f, user_id=071cd7a512064adc8c6721eab5920c5b, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:13.413418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d5074-e813-4a15-a38c-f480771daeed admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:13.424059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1294/2586] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:13 2022] PUT /identity/v3/projects/c4a10f45decf4ca99c94951ef46a089f/users/071cd7a512064adc8c6721eab5920c5b/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:13.434412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fa5f-d0bd-4944-beae-a2625d2a11b1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:13.434703 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fa5f-d0bd-4944-beae-a2625d2a11b1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:13.435018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fa5f-d0bd-4944-beae-a2625d2a11b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:13.465113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-71c8fa5f-d0bd-4944-beae-a2625d2a11b1 None None] MFA Rules not processed for user `071cd7a512064adc8c6721eab5920c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:13.466349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71c8fa5f-d0bd-4944-beae-a2625d2a11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:13.534214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1293/2587] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:13.545129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5074-e813-4a15-a38c-f480771daeed admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:13.547120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ac3d5074-e813-4a15-a38c-f480771daeed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:13.605096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5074-e813-4a15-a38c-f480771daeed admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:13.608749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b557-185b-44aa-a9b5-31e586584324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:13.609360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b557-185b-44aa-a9b5-31e586584324 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:13.609643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b557-185b-44aa-a9b5-31e586584324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:13.609917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b557-185b-44aa-a9b5-31e586584324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:13.619488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911b557-185b-44aa-a9b5-31e586584324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:13.620918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911b557-185b-44aa-a9b5-31e586584324 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:13.630356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1295/2588] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:13.678079 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fa5f-d0bd-4944-beae-a2625d2a11b1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:13.679506 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71c8fa5f-d0bd-4944-beae-a2625d2a11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:13.692462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fa5f-d0bd-4944-beae-a2625d2a11b1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:13.696104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b79795-16b6-4e4b-8fc3-b0b4c51aef9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:13.696712 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b79795-16b6-4e4b-8fc3-b0b4c51aef9f service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:13.696994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b79795-16b6-4e4b-8fc3-b0b4c51aef9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:13.697268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b79795-16b6-4e4b-8fc3-b0b4c51aef9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:13.773169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b79795-16b6-4e4b-8fc3-b0b4c51aef9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:13.774620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b79795-16b6-4e4b-8fc3-b0b4c51aef9f service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:13.783514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1294/2589] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:01:16.721895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b557-185b-44aa-a9b5-31e586584324 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:16.721895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e911b557-185b-44aa-a9b5-31e586584324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:16.792903 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b557-185b-44aa-a9b5-31e586584324 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:16.797561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:16.798209 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:16.798490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:16.798765 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] PATH_INFO: `/v3/users/0cde7cc809d149759eef38149c72817d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:16.800001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cde7cc809d149759eef38149c72817d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:16.801955 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:16.814477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:16.854307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cde7cc809d149759eef38149c72817d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:16.868073 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cde7cc809d149759eef38149c72817d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:16.869351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cde7cc809d149759eef38149c72817d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:16.877470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cde7cc809d149759eef38149c72817d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:16.878216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cde7cc809d149759eef38149c72817d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:16.891306 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1296/2590] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:16 2022] DELETE /identity/v3/users/0cde7cc809d149759eef38149c72817d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:16.896013 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd4b8f-1b38-4624-b9aa-3273a875c402 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:16.896564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd4b8f-1b38-4624-b9aa-3273a875c402 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:16.896564 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd4b8f-1b38-4624-b9aa-3273a875c402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:16.904778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:16.918096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c2fd4b8f-1b38-4624-b9aa-3273a875c402 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:16.919353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c2fd4b8f-1b38-4624-b9aa-3273a875c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:16.989011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1295/2591] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:17.000350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.001780 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.063350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae11b8-450c-4dc8-9295-d3088815f618 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.067165 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b28dc-8cd3-40b1-ab33-b536fcb8e711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.067795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b28dc-8cd3-40b1-ab33-b536fcb8e711 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.068055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b28dc-8cd3-40b1-ab33-b536fcb8e711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.068323 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b28dc-8cd3-40b1-ab33-b536fcb8e711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.077651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b28dc-8cd3-40b1-ab33-b536fcb8e711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.084746 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b28dc-8cd3-40b1-ab33-b536fcb8e711 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.085697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd4b8f-1b38-4624-b9aa-3273a875c402 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.087729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c2fd4b8f-1b38-4624-b9aa-3273a875c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.091208 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1297/2592] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:17.100092 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd4b8f-1b38-4624-b9aa-3273a875c402 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.105349 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.105959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.106243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.106543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] PATH_INFO: `/v3/users/51a36e3353a74a229ac76c6e626d9e2f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.107746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a36e3353a74a229ac76c6e626d9e2f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.109699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.163181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a36e3353a74a229ac76c6e626d9e2f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.172333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a36e3353a74a229ac76c6e626d9e2f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.184957 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a36e3353a74a229ac76c6e626d9e2f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.185658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a36e3353a74a229ac76c6e626d9e2f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.193773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a36e3353a74a229ac76c6e626d9e2f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.204512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1296/2593] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:17 2022] DELETE /identity/v3/users/51a36e3353a74a229ac76c6e626d9e2f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:17.206166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27c5d-1038-45e7-b07d-cebc58a3a3b5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.206657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27c5d-1038-45e7-b07d-cebc58a3a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.207384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27c5d-1038-45e7-b07d-cebc58a3a3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.229363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-00e27c5d-1038-45e7-b07d-cebc58a3a3b5 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:17.230682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-00e27c5d-1038-45e7-b07d-cebc58a3a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.299481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1298/2594] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:17.310836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.312273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.372976 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a9550-82e7-41d0-b2c7-bdc55fe00662 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.376728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af77a56-a8e6-45dc-a31c-ec12468abdc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.377341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77a56-a8e6-45dc-a31c-ec12468abdc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.377615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77a56-a8e6-45dc-a31c-ec12468abdc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.377925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77a56-a8e6-45dc-a31c-ec12468abdc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.389033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77a56-a8e6-45dc-a31c-ec12468abdc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.390489 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77a56-a8e6-45dc-a31c-ec12468abdc9 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.394833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27c5d-1038-45e7-b07d-cebc58a3a3b5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.396989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-00e27c5d-1038-45e7-b07d-cebc58a3a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.401451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1297/2595] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:17.414849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27c5d-1038-45e7-b07d-cebc58a3a3b5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.423263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.423263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.423263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.423263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] PATH_INFO: `/v3/projects/b4c9a0c794ae48cc88b0a68e79ed4e5b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.423801 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4c9a0c794ae48cc88b0a68e79ed4e5b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.424587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.461740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:17.483543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4c9a0c794ae48cc88b0a68e79ed4e5b', 'request_id': 'req-ae0eafb4-5aee-47f0-b139-b81ed930d943'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.491676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4c9a0c794ae48cc88b0a68e79ed4e5b', 'request_id': 'req-ae0eafb4-5aee-47f0-b139-b81ed930d943'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.498190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4c9a0c794ae48cc88b0a68e79ed4e5b', 'request_id': 'req-ae0eafb4-5aee-47f0-b139-b81ed930d943'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.510817 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] The token cache is being invalidate because project b4c9a0c794ae48cc88b0a68e79ed4e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:17.511135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.511809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ae0eafb4-5aee-47f0-b139-b81ed930d943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.513682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1299/2596] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:17 2022] DELETE /identity/v3/projects/b4c9a0c794ae48cc88b0a68e79ed4e5b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:17.518504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10471abe-30c0-402b-aa91-10ad8d2d51e9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.518868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10471abe-30c0-402b-aa91-10ad8d2d51e9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.519252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10471abe-30c0-402b-aa91-10ad8d2d51e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.538643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-10471abe-30c0-402b-aa91-10ad8d2d51e9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:17.539997 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-10471abe-30c0-402b-aa91-10ad8d2d51e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.568796 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:17.618231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1298/2597] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:17.626920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccdeea-44bb-4eb7-8541-72dbc309fb79 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.627210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccdeea-44bb-4eb7-8541-72dbc309fb79 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.627488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccdeea-44bb-4eb7-8541-72dbc309fb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.647733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1eccdeea-44bb-4eb7-8541-72dbc309fb79 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:17.648961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1eccdeea-44bb-4eb7-8541-72dbc309fb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.658682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1300/2598] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:17.663916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10471abe-30c0-402b-aa91-10ad8d2d51e9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.675012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10471abe-30c0-402b-aa91-10ad8d2d51e9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.680206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb10d3-63d7-4ea2-93dc-205e98424612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.681525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb10d3-63d7-4ea2-93dc-205e98424612 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.681939 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb10d3-63d7-4ea2-93dc-205e98424612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.682275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb10d3-63d7-4ea2-93dc-205e98424612 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.683138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb10d3-63d7-4ea2-93dc-205e98424612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:17.683490 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb10d3-63d7-4ea2-93dc-205e98424612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.685184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb10d3-63d7-4ea2-93dc-205e98424612 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.686416 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccdeea-44bb-4eb7-8541-72dbc309fb79 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.687835 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1eccdeea-44bb-4eb7-8541-72dbc309fb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.699420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1299/2599] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:17.699711 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccdeea-44bb-4eb7-8541-72dbc309fb79 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.703683 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb10d3-63d7-4ea2-93dc-205e98424612 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.704469 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.705182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.705537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.705867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] PATH_INFO: `/v3/projects/9ecf03da60d74c199d70701fb6455ac9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.707168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ecf03da60d74c199d70701fb6455ac9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.709645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.715550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb10d3-63d7-4ea2-93dc-205e98424612 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.721330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84861a73-9f94-44b8-8f39-02f4042859f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.722182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84861a73-9f94-44b8-8f39-02f4042859f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.722425 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84861a73-9f94-44b8-8f39-02f4042859f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.722970 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84861a73-9f94-44b8-8f39-02f4042859f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.723408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84861a73-9f94-44b8-8f39-02f4042859f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.725415 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84861a73-9f94-44b8-8f39-02f4042859f9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.754287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1300/2600] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:17 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:17.758866 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84861a73-9f94-44b8-8f39-02f4042859f9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.765631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ecf03da60d74c199d70701fb6455ac9', 'request_id': 'req-4915b1d2-6538-452d-a85a-d14a1cb51ae4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.773754 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ecf03da60d74c199d70701fb6455ac9', 'request_id': 'req-4915b1d2-6538-452d-a85a-d14a1cb51ae4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.780433 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ecf03da60d74c199d70701fb6455ac9', 'request_id': 'req-4915b1d2-6538-452d-a85a-d14a1cb51ae4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.792455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] The token cache is being invalidate because project 9ecf03da60d74c199d70701fb6455ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:17.792744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.793401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.795034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1301/2601] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:17 2022] DELETE /identity/v3/projects/9ecf03da60d74c199d70701fb6455ac9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:17.798821 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.800173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.822730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84861a73-9f94-44b8-8f39-02f4042859f9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.828165 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1cb16-698d-4f37-a612-5a75b96871be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.828785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1cb16-698d-4f37-a612-5a75b96871be admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.829628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1cb16-698d-4f37-a612-5a75b96871be admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.829628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1cb16-698d-4f37-a612-5a75b96871be admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.829981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1cb16-698d-4f37-a612-5a75b96871be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.831969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1cb16-698d-4f37-a612-5a75b96871be admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.858608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1301/2602] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:17 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:17.859845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1cb16-698d-4f37-a612-5a75b96871be admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.861501 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dcf1cb16-698d-4f37-a612-5a75b96871be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:17.869571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b1d2-6538-452d-a85a-d14a1cb51ae4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.874556 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1cb16-698d-4f37-a612-5a75b96871be admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.878552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.879214 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.879492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.879795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] PATH_INFO: `/v3/users/071cd7a512064adc8c6721eab5920c5b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.881243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071cd7a512064adc8c6721eab5920c5b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.882918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134d09f-2530-4116-9b63-1883504a97ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.882918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134d09f-2530-4116-9b63-1883504a97ea admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.882918 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134d09f-2530-4116-9b63-1883504a97ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.883260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134d09f-2530-4116-9b63-1883504a97ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.883471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.883892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134d09f-2530-4116-9b63-1883504a97ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.885568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134d09f-2530-4116-9b63-1883504a97ea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.896058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1302/2603] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:17.901552 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134d09f-2530-4116-9b63-1883504a97ea admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.912081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134d09f-2530-4116-9b63-1883504a97ea admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.918231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ff378-bd77-4cb5-b110-f7929b56c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.918840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff378-bd77-4cb5-b110-f7929b56c16c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.919217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff378-bd77-4cb5-b110-f7929b56c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.919505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff378-bd77-4cb5-b110-f7929b56c16c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.920168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ff378-bd77-4cb5-b110-f7929b56c16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.921647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:17.921902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ff378-bd77-4cb5-b110-f7929b56c16c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.933648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1303/2604] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:17.936838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071cd7a512064adc8c6721eab5920c5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.938111 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ff378-bd77-4cb5-b110-f7929b56c16c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:17.948960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ff378-bd77-4cb5-b110-f7929b56c16c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:17.949196 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071cd7a512064adc8c6721eab5920c5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.949906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071cd7a512064adc8c6721eab5920c5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.953758 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d995e1d-c7f1-4eb4-9f32-15a5e0d4cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:17.954269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d995e1d-c7f1-4eb4-9f32-15a5e0d4cb97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:17.954704 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d995e1d-c7f1-4eb4-9f32-15a5e0d4cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:17.955014 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d995e1d-c7f1-4eb4-9f32-15a5e0d4cb97 admin admin] PATH_INFO: `/v3/projects/ad8aca7d269c4edc82ba15755fb25a07/users/ea0b938214ed479f83d0e2dfae9733e8/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:17.957827 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071cd7a512064adc8c6721eab5920c5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.958479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3ed3cc95-cf2e-4be4-9c24-ac27d96df315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071cd7a512064adc8c6721eab5920c5b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:17.970847 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d995e1d-c7f1-4eb4-9f32-15a5e0d4cb97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8aca7d269c4edc82ba15755fb25a07, user_id=ea0b938214ed479f83d0e2dfae9733e8, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:17.972305 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1302/2605] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:17 2022] DELETE /identity/v3/users/071cd7a512064adc8c6721eab5920c5b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:17.973837 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d995e1d-c7f1-4eb4-9f32-15a5e0d4cb97 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:17.988771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1304/2606] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:17 2022] PUT /identity/v3/projects/ad8aca7d269c4edc82ba15755fb25a07/users/ea0b938214ed479f83d0e2dfae9733e8/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:17.999742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a4032-95f7-4b84-9f62-b50447f55db4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.000025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a4032-95f7-4b84-9f62-b50447f55db4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.000300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a4032-95f7-4b84-9f62-b50447f55db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.030694 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d86a4032-95f7-4b84-9f62-b50447f55db4 None None] MFA Rules not processed for user `ea0b938214ed479f83d0e2dfae9733e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:18.032084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d86a4032-95f7-4b84-9f62-b50447f55db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:18.107513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1303/2607] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:18.112070 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d995e1d-c7f1-4eb4-9f32-15a5e0d4cb97 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.114043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d995e1d-c7f1-4eb4-9f32-15a5e0d4cb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:18.151960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:18.188754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d995e1d-c7f1-4eb4-9f32-15a5e0d4cb97 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.193900 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268504e-539e-4afa-96aa-7c3728c520e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.194599 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268504e-539e-4afa-96aa-7c3728c520e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.194992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268504e-539e-4afa-96aa-7c3728c520e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.195278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268504e-539e-4afa-96aa-7c3728c520e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.195962 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268504e-539e-4afa-96aa-7c3728c520e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.198077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268504e-539e-4afa-96aa-7c3728c520e8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.231342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1305/2608] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:18 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:18.232175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a4032-95f7-4b84-9f62-b50447f55db4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.245190 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a4032-95f7-4b84-9f62-b50447f55db4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.260849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268504e-539e-4afa-96aa-7c3728c520e8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.264093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6268504e-539e-4afa-96aa-7c3728c520e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:18.318688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73210629-b987-43a5-b954-58e8d4af441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.319528 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73210629-b987-43a5-b954-58e8d4af441b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.319867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73210629-b987-43a5-b954-58e8d4af441b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.320173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73210629-b987-43a5-b954-58e8d4af441b admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.320975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73210629-b987-43a5-b954-58e8d4af441b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.323044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73210629-b987-43a5-b954-58e8d4af441b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.335242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268504e-539e-4afa-96aa-7c3728c520e8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.340080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.340719 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.340998 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.341275 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] PATH_INFO: `/v3/projects/c4a10f45decf4ca99c94951ef46a089f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.342495 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a10f45decf4ca99c94951ef46a089f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.344510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.344870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1304/2609] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:18 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:18.349325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73210629-b987-43a5-b954-58e8d4af441b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.359653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73210629-b987-43a5-b954-58e8d4af441b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.364992 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d20f4-6424-4856-812b-86d85c52a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.365612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d20f4-6424-4856-812b-86d85c52a92e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.365893 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d20f4-6424-4856-812b-86d85c52a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.366168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d20f4-6424-4856-812b-86d85c52a92e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.366877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d20f4-6424-4856-812b-86d85c52a92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.369096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d20f4-6424-4856-812b-86d85c52a92e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.380288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1305/2610] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:18.386609 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d20f4-6424-4856-812b-86d85c52a92e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.400429 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d20f4-6424-4856-812b-86d85c52a92e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.411190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a10f45decf4ca99c94951ef46a089f', 'request_id': 'req-8565fbf5-698a-4713-9f85-c6312a5a3a06'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:18.414546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:18.420843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a10f45decf4ca99c94951ef46a089f', 'request_id': 'req-8565fbf5-698a-4713-9f85-c6312a5a3a06'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:18.431707 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a10f45decf4ca99c94951ef46a089f', 'request_id': 'req-8565fbf5-698a-4713-9f85-c6312a5a3a06'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:18.443807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] The token cache is being invalidate because project c4a10f45decf4ca99c94951ef46a089f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:18.444090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:18.444781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8565fbf5-698a-4713-9f85-c6312a5a3a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:18.446540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1306/2611] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:18 2022] DELETE /identity/v3/projects/c4a10f45decf4ca99c94951ef46a089f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:18.451740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7538-fe40-4636-843f-7d175687ba68 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.452248 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7538-fe40-4636-843f-7d175687ba68 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.452822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7538-fe40-4636-843f-7d175687ba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.475904 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4f3d7538-fe40-4636-843f-7d175687ba68 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:18.476793 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5894a69-8cad-45d7-bd05-f20d41a8d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.477137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4f3d7538-fe40-4636-843f-7d175687ba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:18.477470 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5894a69-8cad-45d7-bd05-f20d41a8d038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.478422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5894a69-8cad-45d7-bd05-f20d41a8d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.478697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5894a69-8cad-45d7-bd05-f20d41a8d038 admin admin] PATH_INFO: `/v3/projects/761a631ab740439098053a38d0e269b5/users/838f75d3225e4405994d656977b6f0c9/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.485836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1307/2612] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:18.493634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d477869-4a21-4e79-a056-1d42f9818ecb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.493885 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5894a69-8cad-45d7-bd05-f20d41a8d038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761a631ab740439098053a38d0e269b5, user_id=838f75d3225e4405994d656977b6f0c9, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.494033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d477869-4a21-4e79-a056-1d42f9818ecb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.494174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d477869-4a21-4e79-a056-1d42f9818ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.496633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5894a69-8cad-45d7-bd05-f20d41a8d038 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.510508 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1306/2613] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:18 2022] PUT /identity/v3/projects/761a631ab740439098053a38d0e269b5/users/838f75d3225e4405994d656977b6f0c9/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:18.513791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7d477869-4a21-4e79-a056-1d42f9818ecb None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:18.514375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5894a69-8cad-45d7-bd05-f20d41a8d038 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.515052 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7d477869-4a21-4e79-a056-1d42f9818ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:18.516028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f5894a69-8cad-45d7-bd05-f20d41a8d038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:18.549568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:18.579608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1308/2614] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:18.582929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5894a69-8cad-45d7-bd05-f20d41a8d038 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.583798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d477869-4a21-4e79-a056-1d42f9818ecb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.587905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d151382-49b4-402b-b19c-115597fb5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.588532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d151382-49b4-402b-b19c-115597fb5268 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.588812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d151382-49b4-402b-b19c-115597fb5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.589084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d151382-49b4-402b-b19c-115597fb5268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.589816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d151382-49b4-402b-b19c-115597fb5268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.591457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d151382-49b4-402b-b19c-115597fb5268 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.593272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d477869-4a21-4e79-a056-1d42f9818ecb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.598125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a0210-7e10-4a8f-8296-5b016a3a49fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.598715 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a0210-7e10-4a8f-8296-5b016a3a49fb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.599019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a0210-7e10-4a8f-8296-5b016a3a49fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.599285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a0210-7e10-4a8f-8296-5b016a3a49fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.600005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a0210-7e10-4a8f-8296-5b016a3a49fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:18.600311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a0210-7e10-4a8f-8296-5b016a3a49fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.601758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1307/2615] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:18.601906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a0210-7e10-4a8f-8296-5b016a3a49fb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.606407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d151382-49b4-402b-b19c-115597fb5268 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.617960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1309/2616] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:18.618155 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d151382-49b4-402b-b19c-115597fb5268 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.619136 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a0210-7e10-4a8f-8296-5b016a3a49fb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.622561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328d6f7-d4b4-4daf-ab94-b88499d9382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.623260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328d6f7-d4b4-4daf-ab94-b88499d9382e admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.623541 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328d6f7-d4b4-4daf-ab94-b88499d9382e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.623816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328d6f7-d4b4-4daf-ab94-b88499d9382e admin admin] PATH_INFO: `/v3/projects/761a631ab740439098053a38d0e269b5/users/838f75d3225e4405994d656977b6f0c9/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.625833 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328d6f7-d4b4-4daf-ab94-b88499d9382e admin admin] RBAC: Authorizing `identity:create_grant(project_id=761a631ab740439098053a38d0e269b5, user_id=838f75d3225e4405994d656977b6f0c9, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.628515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328d6f7-d4b4-4daf-ab94-b88499d9382e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.629345 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a0210-7e10-4a8f-8296-5b016a3a49fb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.634106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb0f6-0144-48f0-a690-04ec1835382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.634640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb0f6-0144-48f0-a690-04ec1835382c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.634951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb0f6-0144-48f0-a690-04ec1835382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.635232 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb0f6-0144-48f0-a690-04ec1835382c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.635890 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bb0f6-0144-48f0-a690-04ec1835382c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.637808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bb0f6-0144-48f0-a690-04ec1835382c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.639359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1308/2617] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:18 2022] PUT /identity/v3/projects/761a631ab740439098053a38d0e269b5/users/838f75d3225e4405994d656977b6f0c9/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:18.651389 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1b1b9-7d2f-48bf-b491-251440ef0e61 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.651658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1b1b9-7d2f-48bf-b491-251440ef0e61 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.651930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1b1b9-7d2f-48bf-b491-251440ef0e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.672164 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1310/2618] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:18 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:18.675996 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb0f6-0144-48f0-a690-04ec1835382c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.680676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-02b1b1b9-7d2f-48bf-b491-251440ef0e61 None None] MFA Rules not processed for user `838f75d3225e4405994d656977b6f0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:18.682047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-02b1b1b9-7d2f-48bf-b491-251440ef0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:18.738384 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb0f6-0144-48f0-a690-04ec1835382c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.743044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf42862-8a08-4b61-bc35-2984488f85a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.743717 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf42862-8a08-4b61-bc35-2984488f85a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.743992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf42862-8a08-4b61-bc35-2984488f85a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.744257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf42862-8a08-4b61-bc35-2984488f85a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.744987 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf42862-8a08-4b61-bc35-2984488f85a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.746832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf42862-8a08-4b61-bc35-2984488f85a3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.754667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1309/2619] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:18.767881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1b1b9-7d2f-48bf-b491-251440ef0e61 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.769552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-02b1b1b9-7d2f-48bf-b491-251440ef0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:18.775719 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1311/2620] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:18 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:18.777705 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf42862-8a08-4b61-bc35-2984488f85a3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.781357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:18.791259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf42862-8a08-4b61-bc35-2984488f85a3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.797119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff871ee-d190-40fe-9723-1486a1d31d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.797747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff871ee-d190-40fe-9723-1486a1d31d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.798032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff871ee-d190-40fe-9723-1486a1d31d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.798306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff871ee-d190-40fe-9723-1486a1d31d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.799044 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff871ee-d190-40fe-9723-1486a1d31d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.800655 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff871ee-d190-40fe-9723-1486a1d31d80 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.811059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1312/2621] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:18.814912 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff871ee-d190-40fe-9723-1486a1d31d80 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.825110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff871ee-d190-40fe-9723-1486a1d31d80 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.829795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7210678-1ca2-46b5-bfc6-6b54a02b2ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.830397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7210678-1ca2-46b5-bfc6-6b54a02b2ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.830675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7210678-1ca2-46b5-bfc6-6b54a02b2ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.830982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7210678-1ca2-46b5-bfc6-6b54a02b2ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.831672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7210678-1ca2-46b5-bfc6-6b54a02b2ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.833262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7210678-1ca2-46b5-bfc6-6b54a02b2ebe admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.838625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1b1b9-7d2f-48bf-b491-251440ef0e61 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.842579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e099952-a3f6-42d5-be1e-2efee94b1a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.843209 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099952-a3f6-42d5-be1e-2efee94b1a95 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.843483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099952-a3f6-42d5-be1e-2efee94b1a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.843751 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099952-a3f6-42d5-be1e-2efee94b1a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.846911 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1313/2622] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:18.849020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7210678-1ca2-46b5-bfc6-6b54a02b2ebe admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.857664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e099952-a3f6-42d5-be1e-2efee94b1a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.859138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e099952-a3f6-42d5-be1e-2efee94b1a95 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.859505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7210678-1ca2-46b5-bfc6-6b54a02b2ebe admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:18.864698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde02eb-3230-4a13-9ba4-5abf09b79b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:18.865393 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde02eb-3230-4a13-9ba4-5abf09b79b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.865667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde02eb-3230-4a13-9ba4-5abf09b79b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.865942 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde02eb-3230-4a13-9ba4-5abf09b79b8e admin admin] PATH_INFO: `/v3/projects/7bf51019520e4d7f827e9110b259679c/users/211e25a478974964b0243651d16eddb5/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.869707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1310/2623] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:01:18.881988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde02eb-3230-4a13-9ba4-5abf09b79b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf51019520e4d7f827e9110b259679c, user_id=211e25a478974964b0243651d16eddb5, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:18.885312 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde02eb-3230-4a13-9ba4-5abf09b79b8e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:18.903431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1314/2624] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:18 2022] PUT /identity/v3/projects/7bf51019520e4d7f827e9110b259679c/users/211e25a478974964b0243651d16eddb5/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:18.913452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa42a0-8e07-4743-8285-e33a7ca16ba9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:18.913812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa42a0-8e07-4743-8285-e33a7ca16ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:18.914156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa42a0-8e07-4743-8285-e33a7ca16ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:18.944138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d8aa42a0-8e07-4743-8285-e33a7ca16ba9 None None] MFA Rules not processed for user `211e25a478974964b0243651d16eddb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:18.945556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d8aa42a0-8e07-4743-8285-e33a7ca16ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:18.948706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde02eb-3230-4a13-9ba4-5abf09b79b8e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:18.998090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:19.003702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde02eb-3230-4a13-9ba4-5abf09b79b8e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:19.009441 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1486c-b5cf-4190-9f86-692a2547ba6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:19.010074 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1486c-b5cf-4190-9f86-692a2547ba6e service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.010354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1486c-b5cf-4190-9f86-692a2547ba6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.010631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1486c-b5cf-4190-9f86-692a2547ba6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.012538 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-94e1486c-b5cf-4190-9f86-692a2547ba6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:19.013688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1311/2625] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:19.018033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa42a0-8e07-4743-8285-e33a7ca16ba9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:19.075413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1486c-b5cf-4190-9f86-692a2547ba6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:19.077224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1486c-b5cf-4190-9f86-692a2547ba6e service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:19.084597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa42a0-8e07-4743-8285-e33a7ca16ba9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:19.086701 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1315/2626] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:01:19.089940 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086c3ec-1243-4fd5-a3a2-f7ae8ddd5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:19.090557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086c3ec-1243-4fd5-a3a2-f7ae8ddd5419 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.090977 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086c3ec-1243-4fd5-a3a2-f7ae8ddd5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.091248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086c3ec-1243-4fd5-a3a2-f7ae8ddd5419 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.091911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086c3ec-1243-4fd5-a3a2-f7ae8ddd5419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:19.093976 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086c3ec-1243-4fd5-a3a2-f7ae8ddd5419 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:19.121654 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1312/2627] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:19 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:19.125766 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1486c-b5cf-4190-9f86-692a2547ba6e service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:19.139156 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1486c-b5cf-4190-9f86-692a2547ba6e service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:19.201198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8180e8-a7b9-4f91-a09b-b0960c3a1e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:19.201661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8180e8-a7b9-4f91-a09b-b0960c3a1e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.202114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8180e8-a7b9-4f91-a09b-b0960c3a1e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.202264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8180e8-a7b9-4f91-a09b-b0960c3a1e0a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.203015 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8180e8-a7b9-4f91-a09b-b0960c3a1e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:19.205263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8180e8-a7b9-4f91-a09b-b0960c3a1e0a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:19.231990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1316/2628] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:19 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:19.235918 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086c3ec-1243-4fd5-a3a2-f7ae8ddd5419 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:19.246816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086c3ec-1243-4fd5-a3a2-f7ae8ddd5419 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:19.251779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42721b-0480-4f5f-bace-4d2b323fb013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:19.252388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42721b-0480-4f5f-bace-4d2b323fb013 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.252663 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42721b-0480-4f5f-bace-4d2b323fb013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.252936 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42721b-0480-4f5f-bace-4d2b323fb013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.253626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42721b-0480-4f5f-bace-4d2b323fb013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:19.255241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42721b-0480-4f5f-bace-4d2b323fb013 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:19.267404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1313/2629] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:19.272169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8180e8-a7b9-4f91-a09b-b0960c3a1e0a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:19.282634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8180e8-a7b9-4f91-a09b-b0960c3a1e0a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:19.287413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699111-a756-44c5-983f-b44e6193fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:19.288108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699111-a756-44c5-983f-b44e6193fe8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.288389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699111-a756-44c5-983f-b44e6193fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.288660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699111-a756-44c5-983f-b44e6193fe8d admin admin] PATH_INFO: `/v3/projects/46736e3745914879863a1f35d7526614/users/f4df0e4c4c9241e5bc111609e69c45d7/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.304604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699111-a756-44c5-983f-b44e6193fe8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46736e3745914879863a1f35d7526614, user_id=f4df0e4c4c9241e5bc111609e69c45d7, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:19.307863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699111-a756-44c5-983f-b44e6193fe8d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:19.321389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1317/2630] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:19 2022] PUT /identity/v3/projects/46736e3745914879863a1f35d7526614/users/f4df0e4c4c9241e5bc111609e69c45d7/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:19.326021 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42721b-0480-4f5f-bace-4d2b323fb013 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:19.336142 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42721b-0480-4f5f-bace-4d2b323fb013 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:19.348157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:19.394006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4789f-31ce-4ffe-9a51-272b840020c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:19.394545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4789f-31ce-4ffe-9a51-272b840020c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.394827 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4789f-31ce-4ffe-9a51-272b840020c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.395130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4789f-31ce-4ffe-9a51-272b840020c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.395822 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4789f-31ce-4ffe-9a51-272b840020c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:19.397414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4789f-31ce-4ffe-9a51-272b840020c0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:19.406971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1314/2631] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:19.411360 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699111-a756-44c5-983f-b44e6193fe8d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:19.421617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699111-a756-44c5-983f-b44e6193fe8d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:19.426272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f7e0-a792-49dd-9461-e1ae52c29ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:19.426969 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f7e0-a792-49dd-9461-e1ae52c29ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.427248 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f7e0-a792-49dd-9461-e1ae52c29ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.427516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f7e0-a792-49dd-9461-e1ae52c29ea5 admin admin] PATH_INFO: `/v3/projects/46736e3745914879863a1f35d7526614/users/f4df0e4c4c9241e5bc111609e69c45d7/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.429459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593f7e0-a792-49dd-9461-e1ae52c29ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46736e3745914879863a1f35d7526614, user_id=f4df0e4c4c9241e5bc111609e69c45d7, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:19.432661 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593f7e0-a792-49dd-9461-e1ae52c29ea5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:19.445257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1318/2632] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:19 2022] PUT /identity/v3/projects/46736e3745914879863a1f35d7526614/users/f4df0e4c4c9241e5bc111609e69c45d7/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:19.456290 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec3896-b533-4182-a0dc-20dd06058e10 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.456575 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec3896-b533-4182-a0dc-20dd06058e10 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.456849 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec3896-b533-4182-a0dc-20dd06058e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.484368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-afec3896-b533-4182-a0dc-20dd06058e10 None None] MFA Rules not processed for user `f4df0e4c4c9241e5bc111609e69c45d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:19.485621 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-afec3896-b533-4182-a0dc-20dd06058e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:19.552394 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1315/2633] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:19.563578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f7e0-a792-49dd-9461-e1ae52c29ea5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:19.620739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f7e0-a792-49dd-9461-e1ae52c29ea5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:19.624394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5acc0-69a7-42c1-822c-67606b5e94fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:19.625000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5acc0-69a7-42c1-822c-67606b5e94fd service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.625420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5acc0-69a7-42c1-822c-67606b5e94fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.625610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5acc0-69a7-42c1-822c-67606b5e94fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.632593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:19.635363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5acc0-69a7-42c1-822c-67606b5e94fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:19.637311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5acc0-69a7-42c1-822c-67606b5e94fd service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:19.648354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1319/2634] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:01:19.748181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec3896-b533-4182-a0dc-20dd06058e10 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:19.757797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec3896-b533-4182-a0dc-20dd06058e10 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:19.761425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0ee48-a1d6-49ce-871e-dd748f8e26a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:19.762031 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ee48-a1d6-49ce-871e-dd748f8e26a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:19.762313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ee48-a1d6-49ce-871e-dd748f8e26a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:19.762587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ee48-a1d6-49ce-871e-dd748f8e26a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:19.820204 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0ee48-a1d6-49ce-871e-dd748f8e26a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:19.821686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0ee48-a1d6-49ce-871e-dd748f8e26a8 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:19.830843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1316/2635] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:22.416732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5acc0-69a7-42c1-822c-67606b5e94fd service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:22.483260 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5acc0-69a7-42c1-822c-67606b5e94fd service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:22.487775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:22.488403 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:22.488679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:22.488948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] PATH_INFO: `/v3/users/211e25a478974964b0243651d16eddb5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:22.490101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211e25a478974964b0243651d16eddb5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:22.492076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:22.538465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211e25a478974964b0243651d16eddb5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:22.546549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211e25a478974964b0243651d16eddb5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:22.559774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211e25a478974964b0243651d16eddb5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:22.560551 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211e25a478974964b0243651d16eddb5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:22.567396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211e25a478974964b0243651d16eddb5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:22.574284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1320/2636] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:22 2022] DELETE /identity/v3/users/211e25a478974964b0243651d16eddb5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:22.579059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1ef8e-d025-4c84-bc91-7fade935dee0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:22.579525 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1ef8e-d025-4c84-bc91-7fade935dee0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:22.579612 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1ef8e-d025-4c84-bc91-7fade935dee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:22.598354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dcc1ef8e-d025-4c84-bc91-7fade935dee0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:22.599605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dcc1ef8e-d025-4c84-bc91-7fade935dee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:22.629693 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:22.658297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1317/2637] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:22.668742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:22.670153 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:22.728484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e9a0-da31-4b2b-a11d-5351098de606 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:22.733949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07ef5f-86bc-45ee-9215-f0e971d4b224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:22.734575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07ef5f-86bc-45ee-9215-f0e971d4b224 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:22.734854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07ef5f-86bc-45ee-9215-f0e971d4b224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:22.735158 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07ef5f-86bc-45ee-9215-f0e971d4b224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:22.745448 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07ef5f-86bc-45ee-9215-f0e971d4b224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:22.746945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07ef5f-86bc-45ee-9215-f0e971d4b224 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:22.756325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1321/2638] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:23.032364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1ef8e-d025-4c84-bc91-7fade935dee0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:23.033844 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dcc1ef8e-d025-4c84-bc91-7fade935dee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:23.047633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1ef8e-d025-4c84-bc91-7fade935dee0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:23.052983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:23.054589 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:23.055249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:23.055581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] PATH_INFO: `/v3/projects/7bf51019520e4d7f827e9110b259679c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:23.057008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf51019520e4d7f827e9110b259679c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:23.059411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:23.106645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf51019520e4d7f827e9110b259679c', 'request_id': 'req-35207a61-30a3-4ad8-953f-cd9400bc6c2d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.114180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf51019520e4d7f827e9110b259679c', 'request_id': 'req-35207a61-30a3-4ad8-953f-cd9400bc6c2d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.119878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf51019520e4d7f827e9110b259679c', 'request_id': 'req-35207a61-30a3-4ad8-953f-cd9400bc6c2d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.130952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] The token cache is being invalidate because project 7bf51019520e4d7f827e9110b259679c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:23.131243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.131878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.133388 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1318/2639] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:23 2022] DELETE /identity/v3/projects/7bf51019520e4d7f827e9110b259679c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:23.137760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07ef5f-86bc-45ee-9215-f0e971d4b224 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:23.147623 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07ef5f-86bc-45ee-9215-f0e971d4b224 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:23.160749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:23.205838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:23.206468 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:23.206770 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:23.207080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] PATH_INFO: `/v3/users/f4df0e4c4c9241e5bc111609e69c45d7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:23.208231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4df0e4c4c9241e5bc111609e69c45d7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:23.210142 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:23.256169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4df0e4c4c9241e5bc111609e69c45d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.264020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4df0e4c4c9241e5bc111609e69c45d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.276872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4df0e4c4c9241e5bc111609e69c45d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.277640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4df0e4c4c9241e5bc111609e69c45d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.285522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b30a1539-738d-4524-b095-6c73cf8300fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4df0e4c4c9241e5bc111609e69c45d7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.292419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1322/2640] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:23 2022] DELETE /identity/v3/users/f4df0e4c4c9241e5bc111609e69c45d7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:23.566945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:23.568423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:23.583447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207a61-30a3-4ad8-953f-cd9400bc6c2d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:23.648444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:23.649103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:23.649440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:23.650236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] PATH_INFO: `/v3/projects/46736e3745914879863a1f35d7526614` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:23.651563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46736e3745914879863a1f35d7526614)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:23.653444 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:23.701798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46736e3745914879863a1f35d7526614', 'request_id': 'req-37378a51-429c-48d4-8bc8-93040436239c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.709369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46736e3745914879863a1f35d7526614', 'request_id': 'req-37378a51-429c-48d4-8bc8-93040436239c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.713488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:23.715878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46736e3745914879863a1f35d7526614', 'request_id': 'req-37378a51-429c-48d4-8bc8-93040436239c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.728914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] The token cache is being invalidate because project 46736e3745914879863a1f35d7526614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:23.729201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.729865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-37378a51-429c-48d4-8bc8-93040436239c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:23.731414 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1319/2641] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:23 2022] DELETE /identity/v3/projects/46736e3745914879863a1f35d7526614 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:23.736298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415e737-5e84-4fce-b02d-9e3124fddb53 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:23.736773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415e737-5e84-4fce-b02d-9e3124fddb53 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:23.736895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415e737-5e84-4fce-b02d-9e3124fddb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:23.757357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0415e737-5e84-4fce-b02d-9e3124fddb53 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:23.758572 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0415e737-5e84-4fce-b02d-9e3124fddb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:23.816775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1323/2642] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:23.826493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c0806-78bd-43a9-80d7-4c85ec7c2ecc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:23.826781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c0806-78bd-43a9-80d7-4c85ec7c2ecc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:23.827091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c0806-78bd-43a9-80d7-4c85ec7c2ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:23.846618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-253c0806-78bd-43a9-80d7-4c85ec7c2ecc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:23.848113 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-253c0806-78bd-43a9-80d7-4c85ec7c2ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:23.856107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1320/2643] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:23.860368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415e737-5e84-4fce-b02d-9e3124fddb53 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:23.870639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415e737-5e84-4fce-b02d-9e3124fddb53 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:23.882009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2de6f-546d-489c-805e-1e5ead027f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:23.882769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2de6f-546d-489c-805e-1e5ead027f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:23.883177 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2de6f-546d-489c-805e-1e5ead027f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:23.883597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2de6f-546d-489c-805e-1e5ead027f55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:23.885242 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2de6f-546d-489c-805e-1e5ead027f55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:23.885651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2de6f-546d-489c-805e-1e5ead027f55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:23.887390 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2de6f-546d-489c-805e-1e5ead027f55 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:23.900009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1324/2644] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:23.904371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c0806-78bd-43a9-80d7-4c85ec7c2ecc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:23.913490 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c0806-78bd-43a9-80d7-4c85ec7c2ecc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:23.918229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a4e7d-1968-4447-b5b9-070624a5922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:23.918828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4e7d-1968-4447-b5b9-070624a5922f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:23.919139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4e7d-1968-4447-b5b9-070624a5922f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:23.919413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4e7d-1968-4447-b5b9-070624a5922f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:23.920068 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a4e7d-1968-4447-b5b9-070624a5922f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:23.921948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a4e7d-1968-4447-b5b9-070624a5922f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:23.954642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1321/2645] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:23 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:23.956171 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2de6f-546d-489c-805e-1e5ead027f55 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:23.966819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2de6f-546d-489c-805e-1e5ead027f55 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:23.987545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:24.026615 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcffee7-eeac-48ec-b472-6d02eb3b3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:24.027256 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcffee7-eeac-48ec-b472-6d02eb3b3793 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:24.027532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcffee7-eeac-48ec-b472-6d02eb3b3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:24.027801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcffee7-eeac-48ec-b472-6d02eb3b3793 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:24.028454 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcffee7-eeac-48ec-b472-6d02eb3b3793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:24.030383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcffee7-eeac-48ec-b472-6d02eb3b3793 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:24.051433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1325/2646] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:23 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:24.056524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a4e7d-1968-4447-b5b9-070624a5922f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:24.066758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a4e7d-1968-4447-b5b9-070624a5922f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:24.072083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77787cc3-bde1-4eb2-afc0-2d4ec68a05fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:24.072692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77787cc3-bde1-4eb2-afc0-2d4ec68a05fb admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:24.072969 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77787cc3-bde1-4eb2-afc0-2d4ec68a05fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:24.073239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77787cc3-bde1-4eb2-afc0-2d4ec68a05fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:24.073939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77787cc3-bde1-4eb2-afc0-2d4ec68a05fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:24.075552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77787cc3-bde1-4eb2-afc0-2d4ec68a05fb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:24.085344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1322/2647] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:24.089229 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcffee7-eeac-48ec-b472-6d02eb3b3793 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:24.100353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcffee7-eeac-48ec-b472-6d02eb3b3793 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:24.105660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbab7ef-ccad-4335-aa71-cbd0974c51cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:24.106277 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbab7ef-ccad-4335-aa71-cbd0974c51cb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:24.106562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbab7ef-ccad-4335-aa71-cbd0974c51cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:24.106838 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbab7ef-ccad-4335-aa71-cbd0974c51cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:24.107575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbab7ef-ccad-4335-aa71-cbd0974c51cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:24.109192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbab7ef-ccad-4335-aa71-cbd0974c51cb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:24.121104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1326/2648] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:24.125423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77787cc3-bde1-4eb2-afc0-2d4ec68a05fb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:24.135524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77787cc3-bde1-4eb2-afc0-2d4ec68a05fb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:24.140273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd0562-12a5-4805-9a19-ae91c92612a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:24.140922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd0562-12a5-4805-9a19-ae91c92612a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:24.141201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd0562-12a5-4805-9a19-ae91c92612a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:24.141471 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd0562-12a5-4805-9a19-ae91c92612a1 admin admin] PATH_INFO: `/v3/projects/ab5d3df5b9a5418e95246ec89a22c7df/users/8cf53cae7423436db120a4a0d97affae/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:24.155986 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd0562-12a5-4805-9a19-ae91c92612a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5d3df5b9a5418e95246ec89a22c7df, user_id=8cf53cae7423436db120a4a0d97affae, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:24.158634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd0562-12a5-4805-9a19-ae91c92612a1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:24.171932 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1323/2649] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:24 2022] PUT /identity/v3/projects/ab5d3df5b9a5418e95246ec89a22c7df/users/8cf53cae7423436db120a4a0d97affae/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:24.176921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef214f0-fbeb-42e6-b46b-86b75555fae8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:24.177265 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef214f0-fbeb-42e6-b46b-86b75555fae8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:24.177544 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef214f0-fbeb-42e6-b46b-86b75555fae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:24.197045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6ef214f0-fbeb-42e6-b46b-86b75555fae8 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:24.198281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6ef214f0-fbeb-42e6-b46b-86b75555fae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:24.259909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1327/2650] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:24.269342 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd0562-12a5-4805-9a19-ae91c92612a1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:24.271159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-70fd0562-12a5-4805-9a19-ae91c92612a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:24.327368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd0562-12a5-4805-9a19-ae91c92612a1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:24.330974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab2309-cd17-4543-8805-9b226242e10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:24.331581 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab2309-cd17-4543-8805-9b226242e10b service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:24.331859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab2309-cd17-4543-8805-9b226242e10b service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:24.332128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab2309-cd17-4543-8805-9b226242e10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:24.341965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab2309-cd17-4543-8805-9b226242e10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:24.343422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab2309-cd17-4543-8805-9b226242e10b service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:24.353515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1324/2651] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:24.999084 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea44080-1a9a-4a54-b50e-7eadcf211583 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:24.999558 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea44080-1a9a-4a54-b50e-7eadcf211583 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:24.999644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea44080-1a9a-4a54-b50e-7eadcf211583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:25.029754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dea44080-1a9a-4a54-b50e-7eadcf211583 None None] MFA Rules not processed for user `8cf53cae7423436db120a4a0d97affae`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:25.031036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dea44080-1a9a-4a54-b50e-7eadcf211583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:25.097687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1328/2652] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:25.109633 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab2309-cd17-4543-8805-9b226242e10b service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:25.111141 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1aab2309-cd17-4543-8805-9b226242e10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:25.170163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab2309-cd17-4543-8805-9b226242e10b service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:25.174406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a955a37-3689-480f-983f-133dbe13b489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:25.175057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a955a37-3689-480f-983f-133dbe13b489 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:25.175340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a955a37-3689-480f-983f-133dbe13b489 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:25.175615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a955a37-3689-480f-983f-133dbe13b489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:25.185344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a955a37-3689-480f-983f-133dbe13b489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:25.186796 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a955a37-3689-480f-983f-133dbe13b489 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:25.196104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1325/2653] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:01:27.611010 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bfd22-6cca-43a1-8c1f-0ca0f2e3a639 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:27.611608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bfd22-6cca-43a1-8c1f-0ca0f2e3a639 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:27.611608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bfd22-6cca-43a1-8c1f-0ca0f2e3a639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:27.630769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ac4bfd22-6cca-43a1-8c1f-0ca0f2e3a639 None None] MFA Rules not processed for user `8cf53cae7423436db120a4a0d97affae`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:27.632148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ac4bfd22-6cca-43a1-8c1f-0ca0f2e3a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:27.639699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1329/2654] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:27.885072 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a955a37-3689-480f-983f-133dbe13b489 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:27.886661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8a955a37-3689-480f-983f-133dbe13b489 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:27.899249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a955a37-3689-480f-983f-133dbe13b489 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:27.902846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:27.903479 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:27.903763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:27.904063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:27.905810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:27.915981 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:27.917401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:27.925614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1326/2655] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:28.239659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bfd22-6cca-43a1-8c1f-0ca0f2e3a639 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:28.241093 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ac4bfd22-6cca-43a1-8c1f-0ca0f2e3a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:28.277646 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:28.322342 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bfd22-6cca-43a1-8c1f-0ca0f2e3a639 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:28.327465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff889e-caa6-47a0-8aef-909880fc7544 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:28.328088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff889e-caa6-47a0-8aef-909880fc7544 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:28.328371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff889e-caa6-47a0-8aef-909880fc7544 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:28.328647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff889e-caa6-47a0-8aef-909880fc7544 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:28.330422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-78ff889e-caa6-47a0-8aef-909880fc7544 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:28.342103 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff889e-caa6-47a0-8aef-909880fc7544 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:28.343760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff889e-caa6-47a0-8aef-909880fc7544 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:28.354073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1330/2656] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:30.051565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:30.053075 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:30.069184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604cc99-1a10-4010-b8a4-00dd1049ecc8 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:30.073927 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:30.074591 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:30.074873 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:30.075174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] PATH_INFO: `/v3/users/ea0b938214ed479f83d0e2dfae9733e8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:30.076419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0b938214ed479f83d0e2dfae9733e8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:30.078372 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:30.092267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:30.130974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0b938214ed479f83d0e2dfae9733e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.143276 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0b938214ed479f83d0e2dfae9733e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.144025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0b938214ed479f83d0e2dfae9733e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.152439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0b938214ed479f83d0e2dfae9733e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.153188 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0b938214ed479f83d0e2dfae9733e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.167310 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1327/2657] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:30 2022] DELETE /identity/v3/users/ea0b938214ed479f83d0e2dfae9733e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:30.171906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf75435-f6a7-4546-8173-f5a0208a482e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:30.172481 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf75435-f6a7-4546-8173-f5a0208a482e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:30.172731 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf75435-f6a7-4546-8173-f5a0208a482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:30.192945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fcf75435-f6a7-4546-8173-f5a0208a482e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:30.194285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fcf75435-f6a7-4546-8173-f5a0208a482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:30.256619 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1331/2658] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:30.267111 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:30.268931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:30.329087 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a358717-78c4-437c-8787-58c04a0ebd0e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:30.332815 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997201b6-8fc5-4a74-8c2f-b2c61191af90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:30.333437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997201b6-8fc5-4a74-8c2f-b2c61191af90 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:30.333716 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997201b6-8fc5-4a74-8c2f-b2c61191af90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:30.333984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997201b6-8fc5-4a74-8c2f-b2c61191af90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:30.343460 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997201b6-8fc5-4a74-8c2f-b2c61191af90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:30.344937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997201b6-8fc5-4a74-8c2f-b2c61191af90 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:30.355811 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1328/2659] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:30.842246 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf75435-f6a7-4546-8173-f5a0208a482e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:30.843752 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fcf75435-f6a7-4546-8173-f5a0208a482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:30.856421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf75435-f6a7-4546-8173-f5a0208a482e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:30.861802 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:30.867852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:30.868161 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:30.868431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] PATH_INFO: `/v3/projects/ad8aca7d269c4edc82ba15755fb25a07` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:30.869768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8aca7d269c4edc82ba15755fb25a07)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:30.871825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:30.935475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8aca7d269c4edc82ba15755fb25a07', 'request_id': 'req-b83c4022-f5ea-4776-bc66-9b39ad471695'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.944474 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8aca7d269c4edc82ba15755fb25a07', 'request_id': 'req-b83c4022-f5ea-4776-bc66-9b39ad471695'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.951795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8aca7d269c4edc82ba15755fb25a07', 'request_id': 'req-b83c4022-f5ea-4776-bc66-9b39ad471695'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.964421 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] The token cache is being invalidate because project ad8aca7d269c4edc82ba15755fb25a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:30.964757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.965955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:30.966979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1332/2660] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:30 2022] DELETE /identity/v3/projects/ad8aca7d269c4edc82ba15755fb25a07 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:30.971024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997201b6-8fc5-4a74-8c2f-b2c61191af90 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:30.981150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997201b6-8fc5-4a74-8c2f-b2c61191af90 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:31.042748 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:31.043489 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:31.043803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:31.044101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] PATH_INFO: `/v3/users/838f75d3225e4405994d656977b6f0c9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:31.045288 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=838f75d3225e4405994d656977b6f0c9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:31.047256 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:31.086676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:31.100474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838f75d3225e4405994d656977b6f0c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.112883 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838f75d3225e4405994d656977b6f0c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.113603 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838f75d3225e4405994d656977b6f0c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.121125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838f75d3225e4405994d656977b6f0c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.121867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838f75d3225e4405994d656977b6f0c9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.136960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1329/2661] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:30 2022] DELETE /identity/v3/users/838f75d3225e4405994d656977b6f0c9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:31.157559 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:31.160038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:31.216812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:31.265149 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c4022-f5ea-4776-bc66-9b39ad471695 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:31.349096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396f129-a8fa-45d9-bda4-bb6961c97e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:31.349722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396f129-a8fa-45d9-bda4-bb6961c97e73 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:31.349999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396f129-a8fa-45d9-bda4-bb6961c97e73 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:31.350264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396f129-a8fa-45d9-bda4-bb6961c97e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:31.352067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b396f129-a8fa-45d9-bda4-bb6961c97e73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:31.364405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396f129-a8fa-45d9-bda4-bb6961c97e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:31.366016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396f129-a8fa-45d9-bda4-bb6961c97e73 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:31.378151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1333/2662] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:31.594879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:31.596423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:31.686375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88389c-aaa5-4a37-9e14-540830beeb37 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:31.691201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:31.691859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:31.692135 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:31.692406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] PATH_INFO: `/v3/projects/761a631ab740439098053a38d0e269b5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:31.693803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=761a631ab740439098053a38d0e269b5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:31.695760 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:31.749971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761a631ab740439098053a38d0e269b5', 'request_id': 'req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.758049 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761a631ab740439098053a38d0e269b5', 'request_id': 'req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.765202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761a631ab740439098053a38d0e269b5', 'request_id': 'req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.776995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] The token cache is being invalidate because project 761a631ab740439098053a38d0e269b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:31.777368 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.778037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e3e197c5-db28-4be9-b2c2-2cc5ec2dab5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:31.779544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1330/2663] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:31 2022] DELETE /identity/v3/projects/761a631ab740439098053a38d0e269b5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:31.784747 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8999-36f6-437c-88a5-3c4ec02b1b0c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:31.784891 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8999-36f6-437c-88a5-3c4ec02b1b0c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:31.785208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8999-36f6-437c-88a5-3c4ec02b1b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:31.805808 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e3ed8999-36f6-437c-88a5-3c4ec02b1b0c None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:31.807820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e3ed8999-36f6-437c-88a5-3c4ec02b1b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:31.867718 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1334/2664] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:31.876574 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8674c-c99f-4680-8fb8-74a10373475f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:31.876905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8674c-c99f-4680-8fb8-74a10373475f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:31.877132 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8674c-c99f-4680-8fb8-74a10373475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:31.898476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c6c8674c-c99f-4680-8fb8-74a10373475f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:31.899755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c6c8674c-c99f-4680-8fb8-74a10373475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:31.908387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1331/2665] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:31.912681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed8999-36f6-437c-88a5-3c4ec02b1b0c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:31.923254 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed8999-36f6-437c-88a5-3c4ec02b1b0c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:31.928305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2326d-2887-4d95-a5b2-95351c8991ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:31.928914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2326d-2887-4d95-a5b2-95351c8991ef admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:31.929198 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2326d-2887-4d95-a5b2-95351c8991ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:31.929475 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2326d-2887-4d95-a5b2-95351c8991ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:31.930169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2326d-2887-4d95-a5b2-95351c8991ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:31.930477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2326d-2887-4d95-a5b2-95351c8991ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:31.932123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2326d-2887-4d95-a5b2-95351c8991ef admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:31.946856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1335/2666] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:31.951419 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8674c-c99f-4680-8fb8-74a10373475f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:31.960775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8674c-c99f-4680-8fb8-74a10373475f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:31.966033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252df4a-b1ef-4ada-90ef-a399e24c9b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:31.966643 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252df4a-b1ef-4ada-90ef-a399e24c9b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:31.966948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252df4a-b1ef-4ada-90ef-a399e24c9b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:31.967249 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252df4a-b1ef-4ada-90ef-a399e24c9b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:31.967890 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252df4a-b1ef-4ada-90ef-a399e24c9b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:31.969794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252df4a-b1ef-4ada-90ef-a399e24c9b8a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:31.997301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1332/2667] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:31 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:32.001487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2326d-2887-4d95-a5b2-95351c8991ef admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.011697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2326d-2887-4d95-a5b2-95351c8991ef admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.058237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:32.068643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444eeb-ba18-4bf2-a707-e9cb4111ebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.069257 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444eeb-ba18-4bf2-a707-e9cb4111ebff admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.069539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444eeb-ba18-4bf2-a707-e9cb4111ebff admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.069815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444eeb-ba18-4bf2-a707-e9cb4111ebff admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.070487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b444eeb-ba18-4bf2-a707-e9cb4111ebff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.072576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b444eeb-ba18-4bf2-a707-e9cb4111ebff admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.093447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1336/2668] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:32 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:32.097611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252df4a-b1ef-4ada-90ef-a399e24c9b8a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.108908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252df4a-b1ef-4ada-90ef-a399e24c9b8a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.113524 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d9139-f60c-49f4-a426-76f205706a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.114129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9139-f60c-49f4-a426-76f205706a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.114408 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9139-f60c-49f4-a426-76f205706a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.114698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9139-f60c-49f4-a426-76f205706a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.115426 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d9139-f60c-49f4-a426-76f205706a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.117012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d9139-f60c-49f4-a426-76f205706a28 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.127168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1333/2669] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:32.131096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444eeb-ba18-4bf2-a707-e9cb4111ebff admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.141146 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444eeb-ba18-4bf2-a707-e9cb4111ebff admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.145749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed7327-6de2-4322-a0bd-e0545baeee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.146354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7327-6de2-4322-a0bd-e0545baeee2d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.146635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7327-6de2-4322-a0bd-e0545baeee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.146935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7327-6de2-4322-a0bd-e0545baeee2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.147632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed7327-6de2-4322-a0bd-e0545baeee2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.149221 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed7327-6de2-4322-a0bd-e0545baeee2d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.161429 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1337/2670] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:32.165674 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d9139-f60c-49f4-a426-76f205706a28 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.171626 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:32.179364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d9139-f60c-49f4-a426-76f205706a28 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.185399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b09829-3fb4-40d0-824b-9ec0b05c8615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.186058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b09829-3fb4-40d0-824b-9ec0b05c8615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.186334 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b09829-3fb4-40d0-824b-9ec0b05c8615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.186606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b09829-3fb4-40d0-824b-9ec0b05c8615 admin admin] PATH_INFO: `/v3/projects/75b7595188134d09a3ddfe62b81341d4/users/5094f5ce2fd8408a8809166f7e1a43e8/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.201044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b09829-3fb4-40d0-824b-9ec0b05c8615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b7595188134d09a3ddfe62b81341d4, user_id=5094f5ce2fd8408a8809166f7e1a43e8, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.204456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b09829-3fb4-40d0-824b-9ec0b05c8615 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.220159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1334/2671] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:32 2022] PUT /identity/v3/projects/75b7595188134d09a3ddfe62b81341d4/users/5094f5ce2fd8408a8809166f7e1a43e8/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:32.232777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d31876-16c2-4a99-a4dc-5703d6b95b57 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.233325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d31876-16c2-4a99-a4dc-5703d6b95b57 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.233325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d31876-16c2-4a99-a4dc-5703d6b95b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.390332 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c2d31876-16c2-4a99-a4dc-5703d6b95b57 None None] MFA Rules not processed for user `5094f5ce2fd8408a8809166f7e1a43e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:32.391601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c2d31876-16c2-4a99-a4dc-5703d6b95b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:32.455728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1338/2672] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:32.460244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b09829-3fb4-40d0-824b-9ec0b05c8615 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.519930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b09829-3fb4-40d0-824b-9ec0b05c8615 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.524477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07677676-00a1-4316-8200-993cb3332b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.525083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07677676-00a1-4316-8200-993cb3332b10 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.525357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07677676-00a1-4316-8200-993cb3332b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.526264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07677676-00a1-4316-8200-993cb3332b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.526971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07677676-00a1-4316-8200-993cb3332b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.528853 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07677676-00a1-4316-8200-993cb3332b10 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.555048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1335/2673] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:32 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:32.559049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d31876-16c2-4a99-a4dc-5703d6b95b57 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.569995 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d31876-16c2-4a99-a4dc-5703d6b95b57 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.629988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af72fb2-fcaa-417e-aca7-68bf3f9b2299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.630602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af72fb2-fcaa-417e-aca7-68bf3f9b2299 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.630876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af72fb2-fcaa-417e-aca7-68bf3f9b2299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.631176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af72fb2-fcaa-417e-aca7-68bf3f9b2299 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.631830 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af72fb2-fcaa-417e-aca7-68bf3f9b2299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.633727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af72fb2-fcaa-417e-aca7-68bf3f9b2299 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.655222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1339/2674] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:32 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:32.659239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07677676-00a1-4316-8200-993cb3332b10 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.669455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07677676-00a1-4316-8200-993cb3332b10 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.674247 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c1cb-790c-4734-86fe-c5c4da855a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.674864 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c1cb-790c-4734-86fe-c5c4da855a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.675181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c1cb-790c-4734-86fe-c5c4da855a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.675457 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c1cb-790c-4734-86fe-c5c4da855a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.676163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548c1cb-790c-4734-86fe-c5c4da855a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.677757 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548c1cb-790c-4734-86fe-c5c4da855a87 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.688777 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1336/2675] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:32.692609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af72fb2-fcaa-417e-aca7-68bf3f9b2299 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.702988 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af72fb2-fcaa-417e-aca7-68bf3f9b2299 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.707635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83aca7-affe-4d5f-b130-c36ec01931a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.708239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83aca7-affe-4d5f-b130-c36ec01931a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.708521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83aca7-affe-4d5f-b130-c36ec01931a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.708794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83aca7-affe-4d5f-b130-c36ec01931a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.709515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83aca7-affe-4d5f-b130-c36ec01931a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.711131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83aca7-affe-4d5f-b130-c36ec01931a8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.721524 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1340/2676] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:32.725838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c1cb-790c-4734-86fe-c5c4da855a87 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.735989 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c1cb-790c-4734-86fe-c5c4da855a87 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.740683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74480f05-d311-4e9d-a47e-39af9c26cab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.741336 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480f05-d311-4e9d-a47e-39af9c26cab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.741615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480f05-d311-4e9d-a47e-39af9c26cab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.741886 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480f05-d311-4e9d-a47e-39af9c26cab5 admin admin] PATH_INFO: `/v3/projects/12fcf24dde5243b08296eb7a8c16ea8d/users/ad0c9ebd6963439a9119ae9763b3d574/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.756963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74480f05-d311-4e9d-a47e-39af9c26cab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fcf24dde5243b08296eb7a8c16ea8d, user_id=ad0c9ebd6963439a9119ae9763b3d574, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.759689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74480f05-d311-4e9d-a47e-39af9c26cab5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.773505 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1337/2677] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:32 2022] PUT /identity/v3/projects/12fcf24dde5243b08296eb7a8c16ea8d/users/ad0c9ebd6963439a9119ae9763b3d574/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:32.783732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043f79-5770-4f81-aae6-a20b71bfc4f0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.784017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043f79-5770-4f81-aae6-a20b71bfc4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.784296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043f79-5770-4f81-aae6-a20b71bfc4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.812520 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a0043f79-5770-4f81-aae6-a20b71bfc4f0 None None] MFA Rules not processed for user `ad0c9ebd6963439a9119ae9763b3d574`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:32.813739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a0043f79-5770-4f81-aae6-a20b71bfc4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:32.842313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:32.886101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1341/2678] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:32.890399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74480f05-d311-4e9d-a47e-39af9c26cab5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:32.955108 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74480f05-d311-4e9d-a47e-39af9c26cab5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:32.959856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e708-22d0-4934-afe5-b22ef516aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:32.960480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e708-22d0-4934-afe5-b22ef516aa94 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:32.960982 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e708-22d0-4934-afe5-b22ef516aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:32.961102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e708-22d0-4934-afe5-b22ef516aa94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:32.961706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878e708-22d0-4934-afe5-b22ef516aa94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:32.963706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878e708-22d0-4934-afe5-b22ef516aa94 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:32.990507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1338/2679] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:32 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:32.995208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043f79-5770-4f81-aae6-a20b71bfc4f0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:33.005824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043f79-5770-4f81-aae6-a20b71bfc4f0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:33.065408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a33fda-a761-4c15-933d-748db720a87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:33.065849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a33fda-a761-4c15-933d-748db720a87c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:33.066190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a33fda-a761-4c15-933d-748db720a87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:33.066466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a33fda-a761-4c15-933d-748db720a87c admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:33.067182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a33fda-a761-4c15-933d-748db720a87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:33.069148 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a33fda-a761-4c15-933d-748db720a87c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:33.094990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1342/2680] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:32 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:33.096354 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e708-22d0-4934-afe5-b22ef516aa94 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:33.108787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e708-22d0-4934-afe5-b22ef516aa94 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:33.114329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e67c5-9ea7-479d-8c38-617fa8f89e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:33.115028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e67c5-9ea7-479d-8c38-617fa8f89e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:33.115313 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e67c5-9ea7-479d-8c38-617fa8f89e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:33.115585 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e67c5-9ea7-479d-8c38-617fa8f89e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:33.116335 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e67c5-9ea7-479d-8c38-617fa8f89e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:33.117943 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e67c5-9ea7-479d-8c38-617fa8f89e5b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:33.129637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1339/2681] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:33.133906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a33fda-a761-4c15-933d-748db720a87c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:33.144443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a33fda-a761-4c15-933d-748db720a87c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:33.149207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e4702-c830-4d8a-8b59-b9828b7a6a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:33.149872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4702-c830-4d8a-8b59-b9828b7a6a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:33.150147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4702-c830-4d8a-8b59-b9828b7a6a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:33.150486 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4702-c830-4d8a-8b59-b9828b7a6a75 admin admin] PATH_INFO: `/v3/projects/c7826b0d91c94f0c9ff06134e476b13b/users/cf4aba70812249d59888f3e329027c0d/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:33.166069 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e4702-c830-4d8a-8b59-b9828b7a6a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7826b0d91c94f0c9ff06134e476b13b, user_id=cf4aba70812249d59888f3e329027c0d, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:33.169027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e4702-c830-4d8a-8b59-b9828b7a6a75 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:33.184479 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1343/2682] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:33 2022] PUT /identity/v3/projects/c7826b0d91c94f0c9ff06134e476b13b/users/cf4aba70812249d59888f3e329027c0d/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:33.198330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e67c5-9ea7-479d-8c38-617fa8f89e5b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:33.198330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:33.203745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e67c5-9ea7-479d-8c38-617fa8f89e5b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:33.263601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af95c9c-28ce-4f64-b143-6b98639dfcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:33.264540 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af95c9c-28ce-4f64-b143-6b98639dfcce admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:33.264787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af95c9c-28ce-4f64-b143-6b98639dfcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:33.265099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af95c9c-28ce-4f64-b143-6b98639dfcce admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:33.265857 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af95c9c-28ce-4f64-b143-6b98639dfcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:33.267640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af95c9c-28ce-4f64-b143-6b98639dfcce admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:33.279020 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1340/2683] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:33.283533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e4702-c830-4d8a-8b59-b9828b7a6a75 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:33.295239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e4702-c830-4d8a-8b59-b9828b7a6a75 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:33.300261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af7b49-8f4e-4cc2-b1a2-bf7e15e0c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:33.301045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af7b49-8f4e-4cc2-b1a2-bf7e15e0c380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:33.301455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af7b49-8f4e-4cc2-b1a2-bf7e15e0c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:33.301801 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af7b49-8f4e-4cc2-b1a2-bf7e15e0c380 admin admin] PATH_INFO: `/v3/projects/c7826b0d91c94f0c9ff06134e476b13b/users/cf4aba70812249d59888f3e329027c0d/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:33.303904 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af7b49-8f4e-4cc2-b1a2-bf7e15e0c380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7826b0d91c94f0c9ff06134e476b13b, user_id=cf4aba70812249d59888f3e329027c0d, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:33.306722 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af7b49-8f4e-4cc2-b1a2-bf7e15e0c380 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:33.323133 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1344/2684] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:33 2022] PUT /identity/v3/projects/c7826b0d91c94f0c9ff06134e476b13b/users/cf4aba70812249d59888f3e329027c0d/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:33.335828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7d033-0a6d-4aa5-b0dd-97f7300f8f65 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:33.336124 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7d033-0a6d-4aa5-b0dd-97f7300f8f65 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:33.336395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7d033-0a6d-4aa5-b0dd-97f7300f8f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:33.365095 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a4b7d033-0a6d-4aa5-b0dd-97f7300f8f65 None None] MFA Rules not processed for user `cf4aba70812249d59888f3e329027c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:33.366318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a4b7d033-0a6d-4aa5-b0dd-97f7300f8f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:33.438899 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1341/2685] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:33.449675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af7b49-8f4e-4cc2-b1a2-bf7e15e0c380 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:33.451457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-43af7b49-8f4e-4cc2-b1a2-bf7e15e0c380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:33.510180 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af7b49-8f4e-4cc2-b1a2-bf7e15e0c380 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:33.514138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129b676-e949-404c-b3f9-5b06262041e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:33.514756 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129b676-e949-404c-b3f9-5b06262041e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:33.515063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129b676-e949-404c-b3f9-5b06262041e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:33.515335 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129b676-e949-404c-b3f9-5b06262041e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:33.524677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129b676-e949-404c-b3f9-5b06262041e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:33.526617 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129b676-e949-404c-b3f9-5b06262041e4 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:33.536017 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1345/2686] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:34.040548 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7d033-0a6d-4aa5-b0dd-97f7300f8f65 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:34.042010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a4b7d033-0a6d-4aa5-b0dd-97f7300f8f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:34.054077 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7d033-0a6d-4aa5-b0dd-97f7300f8f65 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:34.057718 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c79bb-ea44-405b-861e-f00839430539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:34.058340 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c79bb-ea44-405b-861e-f00839430539 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:34.058620 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c79bb-ea44-405b-861e-f00839430539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:34.058907 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c79bb-ea44-405b-861e-f00839430539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:34.118366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c79bb-ea44-405b-861e-f00839430539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:34.119953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c79bb-ea44-405b-861e-f00839430539 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:34.129191 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1342/2687] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:37.818854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129b676-e949-404c-b3f9-5b06262041e4 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:37.821038 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1129b676-e949-404c-b3f9-5b06262041e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:37.858516 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:37.934690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129b676-e949-404c-b3f9-5b06262041e4 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:37.942528 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fabb0-5744-4d87-9332-e7ee0906b878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:37.943104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fabb0-5744-4d87-9332-e7ee0906b878 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:37.943841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fabb0-5744-4d87-9332-e7ee0906b878 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:37.943841 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fabb0-5744-4d87-9332-e7ee0906b878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:37.945641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-129fabb0-5744-4d87-9332-e7ee0906b878 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:37.959602 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fabb0-5744-4d87-9332-e7ee0906b878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:37.961209 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fabb0-5744-4d87-9332-e7ee0906b878 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:37.973883 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1346/2688] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:38.268702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c79bb-ea44-405b-861e-f00839430539 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:38.281543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c79bb-ea44-405b-861e-f00839430539 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:38.286647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1420f-7015-4fff-b9a3-72dc7c0d93bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:38.287330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1420f-7015-4fff-b9a3-72dc7c0d93bf service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:38.287606 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1420f-7015-4fff-b9a3-72dc7c0d93bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:38.287869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1420f-7015-4fff-b9a3-72dc7c0d93bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:38.309033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:38.380518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1420f-7015-4fff-b9a3-72dc7c0d93bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:38.384133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1420f-7015-4fff-b9a3-72dc7c0d93bf service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:38.395263 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1343/2689] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:40.661780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fabb0-5744-4d87-9332-e7ee0906b878 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:40.724647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fabb0-5744-4d87-9332-e7ee0906b878 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:40.729204 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:40.729831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:40.730106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:40.730380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] PATH_INFO: `/v3/users/5094f5ce2fd8408a8809166f7e1a43e8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:40.731578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5094f5ce2fd8408a8809166f7e1a43e8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:40.733494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:40.780861 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5094f5ce2fd8408a8809166f7e1a43e8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:40.789829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5094f5ce2fd8408a8809166f7e1a43e8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:40.802562 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5094f5ce2fd8408a8809166f7e1a43e8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:40.803273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5094f5ce2fd8408a8809166f7e1a43e8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:40.810062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5094f5ce2fd8408a8809166f7e1a43e8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:40.816276 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1347/2690] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:40 2022] DELETE /identity/v3/users/5094f5ce2fd8408a8809166f7e1a43e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:40.820904 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775df2f-a40c-468f-a47f-2c3e095057e0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:40.821399 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775df2f-a40c-468f-a47f-2c3e095057e0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:40.821519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775df2f-a40c-468f-a47f-2c3e095057e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:40.841480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8775df2f-a40c-468f-a47f-2c3e095057e0 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:40.842706 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8775df2f-a40c-468f-a47f-2c3e095057e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:40.902403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1344/2691] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:40.912287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:40.913794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:40.947048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:40.978856 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1dc74-37b7-41a3-a71e-b2ad4522b340 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:40.983287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be87b5b-50e9-4526-933f-08bc0b4de88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:40.984346 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be87b5b-50e9-4526-933f-08bc0b4de88b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:40.984825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be87b5b-50e9-4526-933f-08bc0b4de88b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:40.985110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be87b5b-50e9-4526-933f-08bc0b4de88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:40.995920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be87b5b-50e9-4526-933f-08bc0b4de88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:40.997521 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be87b5b-50e9-4526-933f-08bc0b4de88b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:41.007118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1348/2692] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:41.308381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775df2f-a40c-468f-a47f-2c3e095057e0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:41.312985 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8775df2f-a40c-468f-a47f-2c3e095057e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:41.350794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775df2f-a40c-468f-a47f-2c3e095057e0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:41.358250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:41.359013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:41.359361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:41.359498 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be87b5b-50e9-4526-933f-08bc0b4de88b service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:41.359759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] PATH_INFO: `/v3/projects/75b7595188134d09a3ddfe62b81341d4` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:41.361227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b7595188134d09a3ddfe62b81341d4)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:41.363258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:41.371431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be87b5b-50e9-4526-933f-08bc0b4de88b service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:41.376776 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99027e5-c73e-4054-853a-0c620863bb8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:41.377500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99027e5-c73e-4054-853a-0c620863bb8e service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:41.377869 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99027e5-c73e-4054-853a-0c620863bb8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:41.378144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99027e5-c73e-4054-853a-0c620863bb8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:41.380450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c99027e5-c73e-4054-853a-0c620863bb8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:41.393945 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99027e5-c73e-4054-853a-0c620863bb8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:41.395656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99027e5-c73e-4054-853a-0c620863bb8e service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:41.408201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1349/2693] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:01:41.434703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b7595188134d09a3ddfe62b81341d4', 'request_id': 'req-636eadb1-3f40-4a11-9310-3702dd67f38f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.443556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b7595188134d09a3ddfe62b81341d4', 'request_id': 'req-636eadb1-3f40-4a11-9310-3702dd67f38f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.452395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b7595188134d09a3ddfe62b81341d4', 'request_id': 'req-636eadb1-3f40-4a11-9310-3702dd67f38f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.467774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] The token cache is being invalidate because project 75b7595188134d09a3ddfe62b81341d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:41.468157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.469157 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.470753 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1345/2694] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:41 2022] DELETE /identity/v3/projects/75b7595188134d09a3ddfe62b81341d4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:41.475113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99027e5-c73e-4054-853a-0c620863bb8e service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:41.486206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99027e5-c73e-4054-853a-0c620863bb8e service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:41.561047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:41.561692 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:41.562314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:41.562314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] PATH_INFO: `/v3/users/ad0c9ebd6963439a9119ae9763b3d574` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:41.563657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0c9ebd6963439a9119ae9763b3d574)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:41.565671 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:41.642948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0c9ebd6963439a9119ae9763b3d574'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.654420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0c9ebd6963439a9119ae9763b3d574'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.670860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0c9ebd6963439a9119ae9763b3d574'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.671851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0c9ebd6963439a9119ae9763b3d574'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.680828 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0c9ebd6963439a9119ae9763b3d574'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:41.691314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1350/2695] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:41 2022] DELETE /identity/v3/users/ad0c9ebd6963439a9119ae9763b3d574 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:41.997128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:41.998675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:42.016781 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636eadb1-3f40-4a11-9310-3702dd67f38f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:42.077923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:42.097474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:42.098482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:42.098830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:42.099200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] PATH_INFO: `/v3/projects/12fcf24dde5243b08296eb7a8c16ea8d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:42.100480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fcf24dde5243b08296eb7a8c16ea8d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:42.102431 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:42.148859 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fcf24dde5243b08296eb7a8c16ea8d', 'request_id': 'req-5b248016-06bc-4d93-8b28-b78c92c63baa'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.157386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fcf24dde5243b08296eb7a8c16ea8d', 'request_id': 'req-5b248016-06bc-4d93-8b28-b78c92c63baa'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.163284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fcf24dde5243b08296eb7a8c16ea8d', 'request_id': 'req-5b248016-06bc-4d93-8b28-b78c92c63baa'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.176307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] The token cache is being invalidate because project 12fcf24dde5243b08296eb7a8c16ea8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:42.176506 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.177137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.179432 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1346/2696] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:41 2022] DELETE /identity/v3/projects/12fcf24dde5243b08296eb7a8c16ea8d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:42.183831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:42.185894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:42.205600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55756fc7-259c-47bc-806b-de910551348e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:42.256042 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:42.295292 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:42.296026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:42.296972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:42.297340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] PATH_INFO: `/v3/users/cf4aba70812249d59888f3e329027c0d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:42.298950 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4aba70812249d59888f3e329027c0d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:42.301244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:42.362511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4aba70812249d59888f3e329027c0d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.370224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4aba70812249d59888f3e329027c0d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.388926 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4aba70812249d59888f3e329027c0d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.389737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4aba70812249d59888f3e329027c0d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.399780 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8deb3a86-90b2-4ec8-98f8-0bc93e69b1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4aba70812249d59888f3e329027c0d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.406575 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1351/2697] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:42 2022] DELETE /identity/v3/users/cf4aba70812249d59888f3e329027c0d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:42.744268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:42.746369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:42.762735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248016-06bc-4d93-8b28-b78c92c63baa admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:42.849645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:42.850315 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:42.850947 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:42.851234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] PATH_INFO: `/v3/projects/c7826b0d91c94f0c9ff06134e476b13b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:42.854541 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7826b0d91c94f0c9ff06134e476b13b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:42.856488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:42.911666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7826b0d91c94f0c9ff06134e476b13b', 'request_id': 'req-39ad2344-df67-44c8-ab6c-8819bba4b715'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.924686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7826b0d91c94f0c9ff06134e476b13b', 'request_id': 'req-39ad2344-df67-44c8-ab6c-8819bba4b715'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.930956 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7826b0d91c94f0c9ff06134e476b13b', 'request_id': 'req-39ad2344-df67-44c8-ab6c-8819bba4b715'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.944401 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] The token cache is being invalidate because project c7826b0d91c94f0c9ff06134e476b13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:42.944615 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.945271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-39ad2344-df67-44c8-ab6c-8819bba4b715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:42.947211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1347/2698] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:42 2022] DELETE /identity/v3/projects/c7826b0d91c94f0c9ff06134e476b13b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:42.954921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81ec9-6467-472b-a58b-00148e98158b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:42.954921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81ec9-6467-472b-a58b-00148e98158b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:42.954921 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81ec9-6467-472b-a58b-00148e98158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:42.974579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e8e81ec9-6467-472b-a58b-00148e98158b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:42.975827 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e8e81ec9-6467-472b-a58b-00148e98158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:43.046982 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1352/2699] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:43.056376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c14b-cf70-4349-bc92-efe980456ad4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:43.057513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c14b-cf70-4349-bc92-efe980456ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:43.057639 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c14b-cf70-4349-bc92-efe980456ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:43.067144 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:43.080523 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d560c14b-cf70-4349-bc92-efe980456ad4 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:43.082365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d560c14b-cf70-4349-bc92-efe980456ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:43.091861 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1348/2700] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:43.100327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e81ec9-6467-472b-a58b-00148e98158b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:43.116928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e81ec9-6467-472b-a58b-00148e98158b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:43.122769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ead83-afc1-4578-93eb-e99733f46b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:43.123422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ead83-afc1-4578-93eb-e99733f46b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:43.123910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ead83-afc1-4578-93eb-e99733f46b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:43.124189 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ead83-afc1-4578-93eb-e99733f46b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:43.124893 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ead83-afc1-4578-93eb-e99733f46b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:43.125197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ead83-afc1-4578-93eb-e99733f46b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:43.126810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ead83-afc1-4578-93eb-e99733f46b47 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:43.141649 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1353/2701] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:43.146697 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560c14b-cf70-4349-bc92-efe980456ad4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:43.157112 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560c14b-cf70-4349-bc92-efe980456ad4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:43.161794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12430cdc-1c4c-427b-9694-01d53c91fca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:43.162557 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12430cdc-1c4c-427b-9694-01d53c91fca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:43.162838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12430cdc-1c4c-427b-9694-01d53c91fca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:43.163131 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12430cdc-1c4c-427b-9694-01d53c91fca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:43.163797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12430cdc-1c4c-427b-9694-01d53c91fca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:43.165710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12430cdc-1c4c-427b-9694-01d53c91fca7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:43.203153 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1349/2702] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:43 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:43.204644 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ead83-afc1-4578-93eb-e99733f46b47 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:43.216323 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ead83-afc1-4578-93eb-e99733f46b47 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:43.264824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:43.286865 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6218f-06f8-480c-a68b-bfdd90d5c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:43.287614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6218f-06f8-480c-a68b-bfdd90d5c509 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:43.287972 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6218f-06f8-480c-a68b-bfdd90d5c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:43.288331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6218f-06f8-480c-a68b-bfdd90d5c509 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:43.289387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6218f-06f8-480c-a68b-bfdd90d5c509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:43.292368 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6218f-06f8-480c-a68b-bfdd90d5c509 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:43.327458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1354/2703] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:43 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:43.331168 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12430cdc-1c4c-427b-9694-01d53c91fca7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:43.346071 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12430cdc-1c4c-427b-9694-01d53c91fca7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:43.352826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ec66c-bddd-4a58-aa9b-50c414aa94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:43.355114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec66c-bddd-4a58-aa9b-50c414aa94de admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:43.355114 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec66c-bddd-4a58-aa9b-50c414aa94de admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:43.355406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec66c-bddd-4a58-aa9b-50c414aa94de admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:43.359725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ec66c-bddd-4a58-aa9b-50c414aa94de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:43.359725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ec66c-bddd-4a58-aa9b-50c414aa94de admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:43.370301 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1350/2704] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:43.373947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6218f-06f8-480c-a68b-bfdd90d5c509 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:43.384606 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6218f-06f8-480c-a68b-bfdd90d5c509 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:43.390600 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab06886-73d0-407f-807b-fd09b47d3753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:43.391320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06886-73d0-407f-807b-fd09b47d3753 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:43.391622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06886-73d0-407f-807b-fd09b47d3753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:43.391946 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06886-73d0-407f-807b-fd09b47d3753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:43.392823 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab06886-73d0-407f-807b-fd09b47d3753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:43.398055 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab06886-73d0-407f-807b-fd09b47d3753 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:43.417675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1355/2705] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:43.421887 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ec66c-bddd-4a58-aa9b-50c414aa94de admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:43.432730 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ec66c-bddd-4a58-aa9b-50c414aa94de admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:43.438640 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647a410-96c1-4500-9a38-347116f696c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:43.440033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647a410-96c1-4500-9a38-347116f696c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:43.440820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647a410-96c1-4500-9a38-347116f696c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:43.440983 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647a410-96c1-4500-9a38-347116f696c4 admin admin] PATH_INFO: `/v3/projects/e1af7dd8e62144a6a1dba863af2868e3/users/e150b321e0b84fd3944e1456ae0395a4/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:43.464172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647a410-96c1-4500-9a38-347116f696c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1af7dd8e62144a6a1dba863af2868e3, user_id=e150b321e0b84fd3944e1456ae0395a4, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:43.467881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647a410-96c1-4500-9a38-347116f696c4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:43.496756 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1351/2706] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:43 2022] PUT /identity/v3/projects/e1af7dd8e62144a6a1dba863af2868e3/users/e150b321e0b84fd3944e1456ae0395a4/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:43.498088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d9421-73b6-49b8-8ae8-6a0d3ad8e7a1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:43.498374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d9421-73b6-49b8-8ae8-6a0d3ad8e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:43.498647 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d9421-73b6-49b8-8ae8-6a0d3ad8e7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:43.530740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-632d9421-73b6-49b8-8ae8-6a0d3ad8e7a1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:43.530740 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-632d9421-73b6-49b8-8ae8-6a0d3ad8e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:43.622155 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1356/2707] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:43.638496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647a410-96c1-4500-9a38-347116f696c4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:43.641653 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2647a410-96c1-4500-9a38-347116f696c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:43.754828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647a410-96c1-4500-9a38-347116f696c4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:43.767651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f47a5-00dc-4c28-b880-5796a6db1758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:43.768477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f47a5-00dc-4c28-b880-5796a6db1758 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:43.768897 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f47a5-00dc-4c28-b880-5796a6db1758 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:43.769275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f47a5-00dc-4c28-b880-5796a6db1758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:43.787836 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f47a5-00dc-4c28-b880-5796a6db1758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:43.789960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f47a5-00dc-4c28-b880-5796a6db1758 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:43.804634 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1352/2708] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:45.059252 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51465fb1-86bc-4e5f-9eb1-c6dcdf226bb9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:45.059764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51465fb1-86bc-4e5f-9eb1-c6dcdf226bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:45.059862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51465fb1-86bc-4e5f-9eb1-c6dcdf226bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:45.110868 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-51465fb1-86bc-4e5f-9eb1-c6dcdf226bb9 None None] MFA Rules not processed for user `e150b321e0b84fd3944e1456ae0395a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:45.111794 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-51465fb1-86bc-4e5f-9eb1-c6dcdf226bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:45.205214 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1357/2709] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:45.210201 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f47a5-00dc-4c28-b880-5796a6db1758 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:45.221800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f47a5-00dc-4c28-b880-5796a6db1758 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:45.226870 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f667-12fe-4bb2-8071-6edd771a93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:45.227522 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f667-12fe-4bb2-8071-6edd771a93bf admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:45.227808 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f667-12fe-4bb2-8071-6edd771a93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:45.228738 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f667-12fe-4bb2-8071-6edd771a93bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:45.229650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490f667-12fe-4bb2-8071-6edd771a93bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:45.231878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490f667-12fe-4bb2-8071-6edd771a93bf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:45.271402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1353/2710] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:45 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:45.276366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51465fb1-86bc-4e5f-9eb1-c6dcdf226bb9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:45.291917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51465fb1-86bc-4e5f-9eb1-c6dcdf226bb9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:45.357639 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:45.388340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762eb5ac-556f-4496-be1a-6f079fb0de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:45.389452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762eb5ac-556f-4496-be1a-6f079fb0de1f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:45.389734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762eb5ac-556f-4496-be1a-6f079fb0de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:45.390067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762eb5ac-556f-4496-be1a-6f079fb0de1f admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:45.390757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762eb5ac-556f-4496-be1a-6f079fb0de1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:45.392759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762eb5ac-556f-4496-be1a-6f079fb0de1f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:45.429090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1358/2711] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:45 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:45.433900 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f667-12fe-4bb2-8071-6edd771a93bf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:45.450210 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f667-12fe-4bb2-8071-6edd771a93bf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:45.458772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9b494-baa5-4249-8df4-773e312e2c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:45.458772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9b494-baa5-4249-8df4-773e312e2c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:45.458772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9b494-baa5-4249-8df4-773e312e2c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:45.458772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9b494-baa5-4249-8df4-773e312e2c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:45.459325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9b494-baa5-4249-8df4-773e312e2c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:45.459325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9b494-baa5-4249-8df4-773e312e2c5f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:45.474921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1354/2712] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:45.477840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762eb5ac-556f-4496-be1a-6f079fb0de1f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:45.492511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762eb5ac-556f-4496-be1a-6f079fb0de1f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:45.498944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22225665-7f4f-431f-be32-7e72139aff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:45.499963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22225665-7f4f-431f-be32-7e72139aff21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:45.503007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22225665-7f4f-431f-be32-7e72139aff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:45.503007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22225665-7f4f-431f-be32-7e72139aff21 admin admin] PATH_INFO: `/v3/projects/29167f3023444600809220ae7ca738ff/users/835bb870bd274e2f81068d2f67c27583/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:45.526227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22225665-7f4f-431f-be32-7e72139aff21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29167f3023444600809220ae7ca738ff, user_id=835bb870bd274e2f81068d2f67c27583, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:45.529383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22225665-7f4f-431f-be32-7e72139aff21 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:45.549904 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1359/2713] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:45 2022] PUT /identity/v3/projects/29167f3023444600809220ae7ca738ff/users/835bb870bd274e2f81068d2f67c27583/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:45.554923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9b494-baa5-4249-8df4-773e312e2c5f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:45.571878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9b494-baa5-4249-8df4-773e312e2c5f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:45.641949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eabb0-3da3-4286-9e68-0fe07cc5a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:45.642496 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eabb0-3da3-4286-9e68-0fe07cc5a30e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:45.642773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eabb0-3da3-4286-9e68-0fe07cc5a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:45.643324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8eabb0-3da3-4286-9e68-0fe07cc5a30e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:45.643787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8eabb0-3da3-4286-9e68-0fe07cc5a30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:45.646292 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8eabb0-3da3-4286-9e68-0fe07cc5a30e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:45.662066 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1355/2714] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:45.665878 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22225665-7f4f-431f-be32-7e72139aff21 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:45.683408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22225665-7f4f-431f-be32-7e72139aff21 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:45.689116 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9d4f-2506-4c48-a92e-c212da87ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:45.689813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9d4f-2506-4c48-a92e-c212da87ca76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:45.690095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9d4f-2506-4c48-a92e-c212da87ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:45.690370 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf9d4f-2506-4c48-a92e-c212da87ca76 admin admin] PATH_INFO: `/v3/projects/29167f3023444600809220ae7ca738ff/users/835bb870bd274e2f81068d2f67c27583/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:45.692871 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf9d4f-2506-4c48-a92e-c212da87ca76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29167f3023444600809220ae7ca738ff, user_id=835bb870bd274e2f81068d2f67c27583, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:45.698879 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf9d4f-2506-4c48-a92e-c212da87ca76 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:45.711264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1360/2715] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:45 2022] PUT /identity/v3/projects/29167f3023444600809220ae7ca738ff/users/835bb870bd274e2f81068d2f67c27583/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:01:45.838205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eabb0-3da3-4286-9e68-0fe07cc5a30e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:45.840667 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4f8eabb0-3da3-4286-9e68-0fe07cc5a30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:45.859601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8eabb0-3da3-4286-9e68-0fe07cc5a30e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:45.865515 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:45.936991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:45.937648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:45.937922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:45.938192 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] PATH_INFO: `/v3/users/eb3d3ca2457b47a29b7c94bd8be450cd` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:45.940079 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3d3ca2457b47a29b7c94bd8be450cd)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:45.942304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:45.995222 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3d3ca2457b47a29b7c94bd8be450cd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.008555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3d3ca2457b47a29b7c94bd8be450cd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.009307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3d3ca2457b47a29b7c94bd8be450cd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.017446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3d3ca2457b47a29b7c94bd8be450cd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.018086 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0eed9470-c145-49ac-b2f9-8b5920f8d894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3d3ca2457b47a29b7c94bd8be450cd'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.033221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1356/2716] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:45 2022] DELETE /identity/v3/users/eb3d3ca2457b47a29b7c94bd8be450cd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:46.380070 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9d4f-2506-4c48-a92e-c212da87ca76 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:46.382060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d5cf9d4f-2506-4c48-a92e-c212da87ca76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:46.401477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf9d4f-2506-4c48-a92e-c212da87ca76 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:46.487451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:46.488298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:46.488663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:46.489057 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] PATH_INFO: `/v3/projects/690822c00bf34b2d90eee3e2026c78fb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:46.490510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=690822c00bf34b2d90eee3e2026c78fb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:46.493151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:46.559205 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7c35-cbfd-4a5e-8766-5fec8aaf35e2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:46.560083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7c35-cbfd-4a5e-8766-5fec8aaf35e2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:46.560083 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7c35-cbfd-4a5e-8766-5fec8aaf35e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:46.567698 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690822c00bf34b2d90eee3e2026c78fb', 'request_id': 'req-fbada082-0d32-4973-bf17-69b20ef7a51d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.578935 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690822c00bf34b2d90eee3e2026c78fb', 'request_id': 'req-fbada082-0d32-4973-bf17-69b20ef7a51d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.592555 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690822c00bf34b2d90eee3e2026c78fb', 'request_id': 'req-fbada082-0d32-4973-bf17-69b20ef7a51d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.607145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-aaef7c35-cbfd-4a5e-8766-5fec8aaf35e2 None None] MFA Rules not processed for user `835bb870bd274e2f81068d2f67c27583`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:46.609099 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-aaef7c35-cbfd-4a5e-8766-5fec8aaf35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:46.612951 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] The token cache is being invalidate because project 690822c00bf34b2d90eee3e2026c78fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:46.613380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.614515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fbada082-0d32-4973-bf17-69b20ef7a51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:46.617483 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1361/2717] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:46 2022] DELETE /identity/v3/projects/690822c00bf34b2d90eee3e2026c78fb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:46.622400 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e98404-b85e-4a3e-91cd-e9f15cf15ddd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:46.622760 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e98404-b85e-4a3e-91cd-e9f15cf15ddd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:46.623072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e98404-b85e-4a3e-91cd-e9f15cf15ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:46.647076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-03e98404-b85e-4a3e-91cd-e9f15cf15ddd None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:46.648361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-03e98404-b85e-4a3e-91cd-e9f15cf15ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:46.684860 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:46.707891 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1357/2718] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:46.719961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef7c35-cbfd-4a5e-8766-5fec8aaf35e2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:46.721440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-aaef7c35-cbfd-4a5e-8766-5fec8aaf35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:46.736049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1362/2719] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:46.742458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4b07-91ef-494d-bb7e-2ead29a863ca None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:46.742825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4b07-91ef-494d-bb7e-2ead29a863ca None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:46.743212 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4b07-91ef-494d-bb7e-2ead29a863ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:46.745061 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:46.765485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b88d4b07-91ef-494d-bb7e-2ead29a863ca None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:46.767080 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b88d4b07-91ef-494d-bb7e-2ead29a863ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:46.776451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1363/2720] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:46.780820 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d4b07-91ef-494d-bb7e-2ead29a863ca None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:46.790170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d4b07-91ef-494d-bb7e-2ead29a863ca None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:46.795228 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790bcdb-78cb-40d9-bf44-7b9440687a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:46.795709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef7c35-cbfd-4a5e-8766-5fec8aaf35e2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:46.796033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790bcdb-78cb-40d9-bf44-7b9440687a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:46.796399 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790bcdb-78cb-40d9-bf44-7b9440687a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:46.796742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790bcdb-78cb-40d9-bf44-7b9440687a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:46.797532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790bcdb-78cb-40d9-bf44-7b9440687a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:46.797920 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790bcdb-78cb-40d9-bf44-7b9440687a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:46.799648 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790bcdb-78cb-40d9-bf44-7b9440687a5c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:46.800235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1f9f9-4def-4d3b-a2de-2e088435e824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:46.800867 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1f9f9-4def-4d3b-a2de-2e088435e824 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:46.801325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1f9f9-4def-4d3b-a2de-2e088435e824 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:46.801452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1f9f9-4def-4d3b-a2de-2e088435e824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:46.803293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c0f1f9f9-4def-4d3b-a2de-2e088435e824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:46.811916 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1364/2721] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:01:46.816609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790bcdb-78cb-40d9-bf44-7b9440687a5c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:46.827150 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790bcdb-78cb-40d9-bf44-7b9440687a5c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:46.834446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a31b-e8c0-4375-a742-dffa803a8317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:46.835206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a31b-e8c0-4375-a742-dffa803a8317 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:46.835488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a31b-e8c0-4375-a742-dffa803a8317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:46.835765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a31b-e8c0-4375-a742-dffa803a8317 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:46.836469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a31b-e8c0-4375-a742-dffa803a8317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:46.839064 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a31b-e8c0-4375-a742-dffa803a8317 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:46.869273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1f9f9-4def-4d3b-a2de-2e088435e824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:46.870752 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1f9f9-4def-4d3b-a2de-2e088435e824 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:46.875630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1365/2722] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:46 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:46.877327 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a31b-e8c0-4375-a742-dffa803a8317 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:46.882481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1358/2723] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:01:46.953535 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a31b-e8c0-4375-a742-dffa803a8317 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:46.958658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e78d5-bcd6-4b68-8924-97647d165a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:46.959324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e78d5-bcd6-4b68-8924-97647d165a68 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:46.959597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e78d5-bcd6-4b68-8924-97647d165a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:46.959863 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e78d5-bcd6-4b68-8924-97647d165a68 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:46.960524 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e78d5-bcd6-4b68-8924-97647d165a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:46.962435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e78d5-bcd6-4b68-8924-97647d165a68 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:46.985653 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1366/2724] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:46 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:46.990216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1f9f9-4def-4d3b-a2de-2e088435e824 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:47.001852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1f9f9-4def-4d3b-a2de-2e088435e824 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:47.006809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7d92b-7d1c-4c1d-9db9-badd816c34bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:47.007462 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7d92b-7d1c-4c1d-9db9-badd816c34bd admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:47.007741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7d92b-7d1c-4c1d-9db9-badd816c34bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:47.008012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7d92b-7d1c-4c1d-9db9-badd816c34bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:47.008709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7d92b-7d1c-4c1d-9db9-badd816c34bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:47.010463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7d92b-7d1c-4c1d-9db9-badd816c34bd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:47.022065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1359/2725] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:47.027465 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e78d5-bcd6-4b68-8924-97647d165a68 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:47.042094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e78d5-bcd6-4b68-8924-97647d165a68 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:47.050247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a956d-d2de-4115-b14f-a33be3e050c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:47.050877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a956d-d2de-4115-b14f-a33be3e050c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:47.051184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a956d-d2de-4115-b14f-a33be3e050c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:47.051466 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a956d-d2de-4115-b14f-a33be3e050c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:47.052188 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a956d-d2de-4115-b14f-a33be3e050c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:47.053932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a956d-d2de-4115-b14f-a33be3e050c1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:47.066237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1367/2726] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:47.071244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7d92b-7d1c-4c1d-9db9-badd816c34bd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:47.081423 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7d92b-7d1c-4c1d-9db9-badd816c34bd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:47.088995 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf40c5-1883-4785-94cb-cec4ffb15d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:47.089671 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf40c5-1883-4785-94cb-cec4ffb15d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:47.089952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf40c5-1883-4785-94cb-cec4ffb15d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:47.090251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf40c5-1883-4785-94cb-cec4ffb15d19 admin admin] PATH_INFO: `/v3/projects/3b9acef2966547d3b6ce1ec928fd23b2/users/1a2d854b646b4857a8c7006ca66db301/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:47.114715 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf40c5-1883-4785-94cb-cec4ffb15d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9acef2966547d3b6ce1ec928fd23b2, user_id=1a2d854b646b4857a8c7006ca66db301, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:47.119728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf40c5-1883-4785-94cb-cec4ffb15d19 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:47.148152 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1360/2727] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:47 2022] PUT /identity/v3/projects/3b9acef2966547d3b6ce1ec928fd23b2/users/1a2d854b646b4857a8c7006ca66db301/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:47.160777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d7059-abba-48d5-ae60-95daf0662c09 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:47.161201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d7059-abba-48d5-ae60-95daf0662c09 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:47.161574 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d7059-abba-48d5-ae60-95daf0662c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:47.194907 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ee4d7059-abba-48d5-ae60-95daf0662c09 None None] MFA Rules not processed for user `1a2d854b646b4857a8c7006ca66db301`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:47.196515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ee4d7059-abba-48d5-ae60-95daf0662c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:47.272110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:47.279020 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1368/2728] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:01:47.288784 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf40c5-1883-4785-94cb-cec4ffb15d19 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:47.290527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8ebf40c5-1883-4785-94cb-cec4ffb15d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:47.367783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf40c5-1883-4785-94cb-cec4ffb15d19 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:47.373364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d3b0-82d5-4317-b0da-c1dbcd6a8655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0445b52b85994510ad9e66de366ebf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:47.374096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d3b0-82d5-4317-b0da-c1dbcd6a8655 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:47.374381 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d3b0-82d5-4317-b0da-c1dbcd6a8655 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:47.374655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d3b0-82d5-4317-b0da-c1dbcd6a8655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:47.382584 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6d3b0-82d5-4317-b0da-c1dbcd6a8655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:47.384243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6d3b0-82d5-4317-b0da-c1dbcd6a8655 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:47.394030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1361/2729] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:48.315845 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d7059-abba-48d5-ae60-95daf0662c09 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:48.317307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ee4d7059-abba-48d5-ae60-95daf0662c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:48.376641 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d7059-abba-48d5-ae60-95daf0662c09 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:48.380315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe32461-8526-4a39-92e5-6bbd5f1fa78b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:48.380934 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32461-8526-4a39-92e5-6bbd5f1fa78b service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:48.381213 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32461-8526-4a39-92e5-6bbd5f1fa78b service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:48.381488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32461-8526-4a39-92e5-6bbd5f1fa78b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:48.442550 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe32461-8526-4a39-92e5-6bbd5f1fa78b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:48.444081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe32461-8526-4a39-92e5-6bbd5f1fa78b service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:48.453965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1369/2730] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:50.082572 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d3b0-82d5-4317-b0da-c1dbcd6a8655 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:50.098678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:50.144206 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d3b0-82d5-4317-b0da-c1dbcd6a8655 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:50.148895 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:50.149534 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:50.149817 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:50.150090 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] PATH_INFO: `/v3/users/1a2d854b646b4857a8c7006ca66db301` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:50.151854 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2d854b646b4857a8c7006ca66db301)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:50.153911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:50.202723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2d854b646b4857a8c7006ca66db301'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.214837 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2d854b646b4857a8c7006ca66db301'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.215536 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2d854b646b4857a8c7006ca66db301'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.222798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2d854b646b4857a8c7006ca66db301'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.223840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2d854b646b4857a8c7006ca66db301'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.237137 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1362/2731] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:50 2022] DELETE /identity/v3/users/1a2d854b646b4857a8c7006ca66db301 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:50.241610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a20fc-1977-4a99-9931-109cabf5cf96 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:50.242106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a20fc-1977-4a99-9931-109cabf5cf96 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:50.242222 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a20fc-1977-4a99-9931-109cabf5cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:50.262822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-740a20fc-1977-4a99-9931-109cabf5cf96 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:50.264750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-740a20fc-1977-4a99-9931-109cabf5cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:50.329633 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1370/2732] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:50.340145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:50.341645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:50.400539 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c8f8-d8fa-4c0f-a203-4640721b6808 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:50.404914 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45779f42-0cff-4ae0-804a-0e55c372c5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:50.405533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45779f42-0cff-4ae0-804a-0e55c372c5ed service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:50.405814 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45779f42-0cff-4ae0-804a-0e55c372c5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:50.406088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45779f42-0cff-4ae0-804a-0e55c372c5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:50.415726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45779f42-0cff-4ae0-804a-0e55c372c5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:50.417151 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45779f42-0cff-4ae0-804a-0e55c372c5ed service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:50.427458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1363/2733] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:50.715068 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a20fc-1977-4a99-9931-109cabf5cf96 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:50.716447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-740a20fc-1977-4a99-9931-109cabf5cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:50.730176 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a20fc-1977-4a99-9931-109cabf5cf96 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:50.738282 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:50.739007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:50.739298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:50.739565 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] PATH_INFO: `/v3/projects/3b9acef2966547d3b6ce1ec928fd23b2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:50.740834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9acef2966547d3b6ce1ec928fd23b2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:50.742822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:50.790563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:50.793790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9acef2966547d3b6ce1ec928fd23b2', 'request_id': 'req-398381dc-6188-42e9-bc22-a9a71e18ba17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.802284 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9acef2966547d3b6ce1ec928fd23b2', 'request_id': 'req-398381dc-6188-42e9-bc22-a9a71e18ba17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.809532 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9acef2966547d3b6ce1ec928fd23b2', 'request_id': 'req-398381dc-6188-42e9-bc22-a9a71e18ba17'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.821517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] The token cache is being invalidate because project 3b9acef2966547d3b6ce1ec928fd23b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:50.821827 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.822492 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-398381dc-6188-42e9-bc22-a9a71e18ba17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:50.824691 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1371/2734] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:50 2022] DELETE /identity/v3/projects/3b9acef2966547d3b6ce1ec928fd23b2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:50.829627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f430302-7eb8-4c9f-b424-ef528cfd30df None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:50.829920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f430302-7eb8-4c9f-b424-ef528cfd30df None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:50.830197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f430302-7eb8-4c9f-b424-ef528cfd30df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:50.850686 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5f430302-7eb8-4c9f-b424-ef528cfd30df None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:50.851949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5f430302-7eb8-4c9f-b424-ef528cfd30df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:50.886926 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:50.916817 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1364/2735] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:50.924718 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e24501-3a73-4296-874b-31cce671cf3d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:50.925000 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e24501-3a73-4296-874b-31cce671cf3d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:50.925271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e24501-3a73-4296-874b-31cce671cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:50.945534 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-42e24501-3a73-4296-874b-31cce671cf3d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:50.946786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-42e24501-3a73-4296-874b-31cce671cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:50.955487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1372/2736] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:50.959759 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f430302-7eb8-4c9f-b424-ef528cfd30df None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:50.969803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f430302-7eb8-4c9f-b424-ef528cfd30df None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:50.974991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c68eda-a395-4d67-8cc6-a4ca9d2cc743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:50.975600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c68eda-a395-4d67-8cc6-a4ca9d2cc743 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:50.975877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c68eda-a395-4d67-8cc6-a4ca9d2cc743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:50.976148 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c68eda-a395-4d67-8cc6-a4ca9d2cc743 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:50.976843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c68eda-a395-4d67-8cc6-a4ca9d2cc743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:50.977147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c68eda-a395-4d67-8cc6-a4ca9d2cc743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:50.978734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c68eda-a395-4d67-8cc6-a4ca9d2cc743 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:50.991202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1365/2737] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:01:50.995940 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e24501-3a73-4296-874b-31cce671cf3d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.007610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e24501-3a73-4296-874b-31cce671cf3d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.015216 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377dea4-5b83-4a21-924f-55d50645375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.015831 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377dea4-5b83-4a21-924f-55d50645375c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.016112 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377dea4-5b83-4a21-924f-55d50645375c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.016383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377dea4-5b83-4a21-924f-55d50645375c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.017045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377dea4-5b83-4a21-924f-55d50645375c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.018978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377dea4-5b83-4a21-924f-55d50645375c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.058279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1373/2738] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:50 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:51.062238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c68eda-a395-4d67-8cc6-a4ca9d2cc743 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.072337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c68eda-a395-4d67-8cc6-a4ca9d2cc743 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.148082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dced8-b784-401c-89b7-674ab078b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.148858 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dced8-b784-401c-89b7-674ab078b6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.149003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dced8-b784-401c-89b7-674ab078b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.149239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dced8-b784-401c-89b7-674ab078b6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.149906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dced8-b784-401c-89b7-674ab078b6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.151874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dced8-b784-401c-89b7-674ab078b6e5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.176400 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1366/2739] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:51 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:51.181030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377dea4-5b83-4a21-924f-55d50645375c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.193019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377dea4-5b83-4a21-924f-55d50645375c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.198324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eb74b-e4a1-4f65-be63-a6d1dc70d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.198961 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eb74b-e4a1-4f65-be63-a6d1dc70d5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.199281 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eb74b-e4a1-4f65-be63-a6d1dc70d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.199513 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eb74b-e4a1-4f65-be63-a6d1dc70d5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.200218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eb74b-e4a1-4f65-be63-a6d1dc70d5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.201917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eb74b-e4a1-4f65-be63-a6d1dc70d5c7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.212434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1374/2740] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:51.216480 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dced8-b784-401c-89b7-674ab078b6e5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.227473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dced8-b784-401c-89b7-674ab078b6e5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.234452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f529b-2171-45f2-a5c9-ce19777c1536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.235117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f529b-2171-45f2-a5c9-ce19777c1536 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.235543 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f529b-2171-45f2-a5c9-ce19777c1536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.235828 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f529b-2171-45f2-a5c9-ce19777c1536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.236778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f529b-2171-45f2-a5c9-ce19777c1536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.238459 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f529b-2171-45f2-a5c9-ce19777c1536 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.250198 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1367/2741] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:01:51.255082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eb74b-e4a1-4f65-be63-a6d1dc70d5c7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.273405 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eb74b-e4a1-4f65-be63-a6d1dc70d5c7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.279309 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef42291-bb14-478d-a9b8-d8e33ae6f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.280406 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef42291-bb14-478d-a9b8-d8e33ae6f331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.280979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef42291-bb14-478d-a9b8-d8e33ae6f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.281610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef42291-bb14-478d-a9b8-d8e33ae6f331 admin admin] PATH_INFO: `/v3/projects/82d311feb5a14bb994a24608eb1228f7/users/7738ca51cf3c41a880c62413281a2305/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.304829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef42291-bb14-478d-a9b8-d8e33ae6f331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d311feb5a14bb994a24608eb1228f7, user_id=7738ca51cf3c41a880c62413281a2305, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.310381 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef42291-bb14-478d-a9b8-d8e33ae6f331 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.338775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1375/2742] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:51 2022] PUT /identity/v3/projects/82d311feb5a14bb994a24608eb1228f7/users/7738ca51cf3c41a880c62413281a2305/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:51.359617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbf535-029c-42bb-a6eb-6b25933df278 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.359617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbf535-029c-42bb-a6eb-6b25933df278 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.359617 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbf535-029c-42bb-a6eb-6b25933df278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.390393 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f4cbf535-029c-42bb-a6eb-6b25933df278 None None] MFA Rules not processed for user `7738ca51cf3c41a880c62413281a2305`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:51.391734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f4cbf535-029c-42bb-a6eb-6b25933df278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:51.464233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1368/2743] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:51.468634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef42291-bb14-478d-a9b8-d8e33ae6f331 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.531882 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef42291-bb14-478d-a9b8-d8e33ae6f331 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.537358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79045db-2b49-42ae-8098-43919c06bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.538003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79045db-2b49-42ae-8098-43919c06bee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.538367 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79045db-2b49-42ae-8098-43919c06bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.538734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79045db-2b49-42ae-8098-43919c06bee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.539442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79045db-2b49-42ae-8098-43919c06bee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.541464 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79045db-2b49-42ae-8098-43919c06bee1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.571404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1376/2744] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:51 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:51.575560 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbf535-029c-42bb-a6eb-6b25933df278 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.586795 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbf535-029c-42bb-a6eb-6b25933df278 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.618838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:51.647057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48772e-cbbc-4fe2-af89-9df3922ca7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.647675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48772e-cbbc-4fe2-af89-9df3922ca7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.647973 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48772e-cbbc-4fe2-af89-9df3922ca7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.648258 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48772e-cbbc-4fe2-af89-9df3922ca7a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.648945 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48772e-cbbc-4fe2-af89-9df3922ca7a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.650841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48772e-cbbc-4fe2-af89-9df3922ca7a2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.677437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1369/2745] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:51 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:51.679040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79045db-2b49-42ae-8098-43919c06bee1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.690016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79045db-2b49-42ae-8098-43919c06bee1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.695729 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a8c61-34ec-4bda-bdff-23e31f75edf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.696358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a8c61-34ec-4bda-bdff-23e31f75edf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.696635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a8c61-34ec-4bda-bdff-23e31f75edf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.696899 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a8c61-34ec-4bda-bdff-23e31f75edf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.697596 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a8c61-34ec-4bda-bdff-23e31f75edf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.700077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a8c61-34ec-4bda-bdff-23e31f75edf9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.715160 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1377/2746] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:51.719392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48772e-cbbc-4fe2-af89-9df3922ca7a2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.730507 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48772e-cbbc-4fe2-af89-9df3922ca7a2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.735357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021a2a4-9296-4486-b82c-f792834ca310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.736054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021a2a4-9296-4486-b82c-f792834ca310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.736338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021a2a4-9296-4486-b82c-f792834ca310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.736614 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021a2a4-9296-4486-b82c-f792834ca310 admin admin] PATH_INFO: `/v3/projects/ca6842723311451598bfdc95bc2170b3/users/26371b0c1cb24a41b0a1ddc5890a8676/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.751898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021a2a4-9296-4486-b82c-f792834ca310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6842723311451598bfdc95bc2170b3, user_id=26371b0c1cb24a41b0a1ddc5890a8676, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.754580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021a2a4-9296-4486-b82c-f792834ca310 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.769731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1370/2747] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:51 2022] PUT /identity/v3/projects/ca6842723311451598bfdc95bc2170b3/users/26371b0c1cb24a41b0a1ddc5890a8676/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:51.774075 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a8c61-34ec-4bda-bdff-23e31f75edf9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.784517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a8c61-34ec-4bda-bdff-23e31f75edf9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.826672 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:51.843634 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947ea3f-5220-4eb6-bef9-a74869b36276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.844243 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947ea3f-5220-4eb6-bef9-a74869b36276 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.844515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947ea3f-5220-4eb6-bef9-a74869b36276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.844783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947ea3f-5220-4eb6-bef9-a74869b36276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.845645 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947ea3f-5220-4eb6-bef9-a74869b36276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.847769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947ea3f-5220-4eb6-bef9-a74869b36276 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.858035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1378/2748] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:51.862425 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021a2a4-9296-4486-b82c-f792834ca310 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:51.872892 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021a2a4-9296-4486-b82c-f792834ca310 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:51.878036 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3104f-f632-473d-9439-af604c582b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:51.878710 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3104f-f632-473d-9439-af604c582b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.879029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3104f-f632-473d-9439-af604c582b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.879308 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3104f-f632-473d-9439-af604c582b92 admin admin] PATH_INFO: `/v3/projects/ca6842723311451598bfdc95bc2170b3/users/26371b0c1cb24a41b0a1ddc5890a8676/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.881345 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3104f-f632-473d-9439-af604c582b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6842723311451598bfdc95bc2170b3, user_id=26371b0c1cb24a41b0a1ddc5890a8676, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:51.884050 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3104f-f632-473d-9439-af604c582b92 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:51.896324 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1371/2749] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:51 2022] PUT /identity/v3/projects/ca6842723311451598bfdc95bc2170b3/users/26371b0c1cb24a41b0a1ddc5890a8676/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:51.909067 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bd71f-d154-4185-913a-a3b9071f78c7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:51.909380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bd71f-d154-4185-913a-a3b9071f78c7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:51.909664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bd71f-d154-4185-913a-a3b9071f78c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:51.939070 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-093bd71f-d154-4185-913a-a3b9071f78c7 None None] MFA Rules not processed for user `26371b0c1cb24a41b0a1ddc5890a8676`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:51.940306 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-093bd71f-d154-4185-913a-a3b9071f78c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:52.014539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1379/2750] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:52.026991 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3104f-f632-473d-9439-af604c582b92 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:52.028744 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-34d3104f-f632-473d-9439-af604c582b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:52.086610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3104f-f632-473d-9439-af604c582b92 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:52.090863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ab1ee-296b-4f99-8328-8a8aff0024cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:52.091517 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ab1ee-296b-4f99-8328-8a8aff0024cb service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:52.091794 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ab1ee-296b-4f99-8328-8a8aff0024cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:52.092063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ab1ee-296b-4f99-8328-8a8aff0024cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:52.101286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ab1ee-296b-4f99-8328-8a8aff0024cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:52.102721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ab1ee-296b-4f99-8328-8a8aff0024cb service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:52.113349 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1372/2751] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:52.192621 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bd71f-d154-4185-913a-a3b9071f78c7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:52.203925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bd71f-d154-4185-913a-a3b9071f78c7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:52.208063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e66713-331e-4ccf-ba51-ae65e9bb44d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:52.208676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e66713-331e-4ccf-ba51-ae65e9bb44d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:52.208954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e66713-331e-4ccf-ba51-ae65e9bb44d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:52.209227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e66713-331e-4ccf-ba51-ae65e9bb44d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:52.277656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e66713-331e-4ccf-ba51-ae65e9bb44d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:52.279377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e66713-331e-4ccf-ba51-ae65e9bb44d5 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:52.288720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1380/2752] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:55.052059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ab1ee-296b-4f99-8328-8a8aff0024cb service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:55.117704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ab1ee-296b-4f99-8328-8a8aff0024cb service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:55.122931 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:55.123569 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:55.123847 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:55.124115 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] PATH_INFO: `/v3/users/7738ca51cf3c41a880c62413281a2305` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:55.125283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7738ca51cf3c41a880c62413281a2305)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:55.127231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:55.161740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:55.177735 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7738ca51cf3c41a880c62413281a2305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.189619 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7738ca51cf3c41a880c62413281a2305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.190275 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7738ca51cf3c41a880c62413281a2305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.198440 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7738ca51cf3c41a880c62413281a2305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.199088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7738ca51cf3c41a880c62413281a2305'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.211556 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1373/2753] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:55 2022] DELETE /identity/v3/users/7738ca51cf3c41a880c62413281a2305 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:55.216624 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1554d0-5ad0-455d-9573-c9b666a3a979 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:55.217109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1554d0-5ad0-455d-9573-c9b666a3a979 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:55.217236 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1554d0-5ad0-455d-9573-c9b666a3a979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:55.236786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fe1554d0-5ad0-455d-9573-c9b666a3a979 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:55.238011 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe1554d0-5ad0-455d-9573-c9b666a3a979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:55.299424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1381/2754] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:55.309684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:55.311192 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:55.367721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe9068-025c-422b-bc7a-5f6cc0ab5c9e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:55.371905 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b16b8d-baaa-4a4e-a094-599abd66893f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:55.372518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b16b8d-baaa-4a4e-a094-599abd66893f service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:55.372800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b16b8d-baaa-4a4e-a094-599abd66893f service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:55.373076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b16b8d-baaa-4a4e-a094-599abd66893f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:55.382047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b16b8d-baaa-4a4e-a094-599abd66893f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:55.383566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b16b8d-baaa-4a4e-a094-599abd66893f service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:55.393745 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1374/2755] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:01:55.667267 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1554d0-5ad0-455d-9573-c9b666a3a979 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:55.669268 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe1554d0-5ad0-455d-9573-c9b666a3a979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:55.677457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:55.682563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1554d0-5ad0-455d-9573-c9b666a3a979 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:55.688519 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:55.689713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:55.690170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:55.690451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] PATH_INFO: `/v3/projects/82d311feb5a14bb994a24608eb1228f7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:55.691663 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d311feb5a14bb994a24608eb1228f7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:55.693560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:55.744437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d311feb5a14bb994a24608eb1228f7', 'request_id': 'req-1c9cb015-9d46-432b-a243-2882972d8d97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.752797 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d311feb5a14bb994a24608eb1228f7', 'request_id': 'req-1c9cb015-9d46-432b-a243-2882972d8d97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.758205 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d311feb5a14bb994a24608eb1228f7', 'request_id': 'req-1c9cb015-9d46-432b-a243-2882972d8d97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.769978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] The token cache is being invalidate because project 82d311feb5a14bb994a24608eb1228f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:55.770269 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.770955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.773131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1382/2756] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:55 2022] DELETE /identity/v3/projects/82d311feb5a14bb994a24608eb1228f7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:55.777146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b16b8d-baaa-4a4e-a094-599abd66893f service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:55.786807 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b16b8d-baaa-4a4e-a094-599abd66893f service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:55.844676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:55.845320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:55.845597 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:55.845898 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] PATH_INFO: `/v3/users/26371b0c1cb24a41b0a1ddc5890a8676` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:55.847111 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26371b0c1cb24a41b0a1ddc5890a8676)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:55.849434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:55.898963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26371b0c1cb24a41b0a1ddc5890a8676'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.903856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:55.913403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26371b0c1cb24a41b0a1ddc5890a8676'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.914101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26371b0c1cb24a41b0a1ddc5890a8676'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.922398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26371b0c1cb24a41b0a1ddc5890a8676'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.923055 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4cb3e13a-d40c-4f6d-a0c6-153ccca14387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26371b0c1cb24a41b0a1ddc5890a8676'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:55.936197 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1375/2757] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:55 2022] DELETE /identity/v3/users/26371b0c1cb24a41b0a1ddc5890a8676 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:56.222771 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:56.224682 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:56.243735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cb015-9d46-432b-a243-2882972d8d97 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:56.317442 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:56.318247 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.318616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.319237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] PATH_INFO: `/v3/projects/ca6842723311451598bfdc95bc2170b3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.320568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6842723311451598bfdc95bc2170b3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:56.322852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:56.380082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6842723311451598bfdc95bc2170b3', 'request_id': 'req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:56.387517 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6842723311451598bfdc95bc2170b3', 'request_id': 'req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:56.393002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6842723311451598bfdc95bc2170b3', 'request_id': 'req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:56.404186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] The token cache is being invalidate because project ca6842723311451598bfdc95bc2170b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:56.404470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:56.405108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0493ee2b-53b7-46fe-ad12-b71f9e5a6711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:56.406630 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1383/2758] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:56 2022] DELETE /identity/v3/projects/ca6842723311451598bfdc95bc2170b3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:56.411502 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dd27f-bf1d-4d2c-b432-d225f33b1249 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.411997 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dd27f-bf1d-4d2c-b432-d225f33b1249 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.412100 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dd27f-bf1d-4d2c-b432-d225f33b1249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.432337 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0e9dd27f-bf1d-4d2c-b432-d225f33b1249 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:56.434240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0e9dd27f-bf1d-4d2c-b432-d225f33b1249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:56.496852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1376/2759] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:56.504993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143fc72-c00c-4c56-a6c1-bd72567897ce None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.505285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143fc72-c00c-4c56-a6c1-bd72567897ce None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.505563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143fc72-c00c-4c56-a6c1-bd72567897ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.525101 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7143fc72-c00c-4c56-a6c1-bd72567897ce None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:56.526308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7143fc72-c00c-4c56-a6c1-bd72567897ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:56.534371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1384/2760] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:56.538720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dd27f-bf1d-4d2c-b432-d225f33b1249 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:56.548856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dd27f-bf1d-4d2c-b432-d225f33b1249 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:56.553477 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55ceb-4ccb-4564-8c85-3c9c425feb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:56.554080 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55ceb-4ccb-4564-8c85-3c9c425feb72 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.554359 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55ceb-4ccb-4564-8c85-3c9c425feb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.554630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55ceb-4ccb-4564-8c85-3c9c425feb72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.555361 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b55ceb-4ccb-4564-8c85-3c9c425feb72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:56.555657 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b55ceb-4ccb-4564-8c85-3c9c425feb72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:56.557240 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b55ceb-4ccb-4564-8c85-3c9c425feb72 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:56.569332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1377/2761] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:56.573658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143fc72-c00c-4c56-a6c1-bd72567897ce None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:56.585836 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143fc72-c00c-4c56-a6c1-bd72567897ce None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:56.590702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a261c61-f72a-45cc-a811-a514867dc96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:56.591357 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261c61-f72a-45cc-a811-a514867dc96b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.591637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261c61-f72a-45cc-a811-a514867dc96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.591919 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261c61-f72a-45cc-a811-a514867dc96b admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.592580 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a261c61-f72a-45cc-a811-a514867dc96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:56.594511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a261c61-f72a-45cc-a811-a514867dc96b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:56.604317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:56.628004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1385/2762] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:56 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:56.632392 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55ceb-4ccb-4564-8c85-3c9c425feb72 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:56.642610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55ceb-4ccb-4564-8c85-3c9c425feb72 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:56.701260 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb410b4-1841-4453-ba83-9248b3e7a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:56.701880 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb410b4-1841-4453-ba83-9248b3e7a27a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.702163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb410b4-1841-4453-ba83-9248b3e7a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.702437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb410b4-1841-4453-ba83-9248b3e7a27a admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.703149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb410b4-1841-4453-ba83-9248b3e7a27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:56.705063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb410b4-1841-4453-ba83-9248b3e7a27a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:56.726185 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1378/2763] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:56 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:01:56.730358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a261c61-f72a-45cc-a811-a514867dc96b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:56.741388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a261c61-f72a-45cc-a811-a514867dc96b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:56.746009 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37fb8-1bd2-4032-8cc5-79b0e26bdd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:56.746637 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37fb8-1bd2-4032-8cc5-79b0e26bdd57 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.746949 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37fb8-1bd2-4032-8cc5-79b0e26bdd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.747225 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37fb8-1bd2-4032-8cc5-79b0e26bdd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.747948 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e37fb8-1bd2-4032-8cc5-79b0e26bdd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:56.749536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e37fb8-1bd2-4032-8cc5-79b0e26bdd57 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:56.759484 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1386/2764] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:56.763363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb410b4-1841-4453-ba83-9248b3e7a27a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:56.773163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb410b4-1841-4453-ba83-9248b3e7a27a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:56.778321 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b87e6-1f64-4e17-9454-fab893b0585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:56.778964 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b87e6-1f64-4e17-9454-fab893b0585d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.779248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b87e6-1f64-4e17-9454-fab893b0585d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.779529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b87e6-1f64-4e17-9454-fab893b0585d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.780227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b87e6-1f64-4e17-9454-fab893b0585d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:56.781815 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b87e6-1f64-4e17-9454-fab893b0585d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:56.792184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1379/2765] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:56.796876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37fb8-1bd2-4032-8cc5-79b0e26bdd57 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:56.806971 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37fb8-1bd2-4032-8cc5-79b0e26bdd57 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:56.811497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0425f29-030e-498b-92a6-fe784266a262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:56.812147 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0425f29-030e-498b-92a6-fe784266a262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.812450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0425f29-030e-498b-92a6-fe784266a262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.812724 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0425f29-030e-498b-92a6-fe784266a262 admin admin] PATH_INFO: `/v3/projects/9f711115126c4970b7da1b8c7ca1df13/users/91159b9635cf43bd90cefbcce6f96ae3/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.828922 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0425f29-030e-498b-92a6-fe784266a262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f711115126c4970b7da1b8c7ca1df13, user_id=91159b9635cf43bd90cefbcce6f96ae3, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:56.831664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0425f29-030e-498b-92a6-fe784266a262 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:56.844979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1387/2766] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:56 2022] PUT /identity/v3/projects/9f711115126c4970b7da1b8c7ca1df13/users/91159b9635cf43bd90cefbcce6f96ae3/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:56.855816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507304-3b74-4868-a7b3-e4aa06b5bae7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:56.856642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507304-3b74-4868-a7b3-e4aa06b5bae7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:56.856923 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507304-3b74-4868-a7b3-e4aa06b5bae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:56.885853 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-98507304-3b74-4868-a7b3-e4aa06b5bae7 None None] MFA Rules not processed for user `91159b9635cf43bd90cefbcce6f96ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:56.887355 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-98507304-3b74-4868-a7b3-e4aa06b5bae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:56.911692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:56.957211 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1380/2767] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:56.961737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0425f29-030e-498b-92a6-fe784266a262 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:57.022985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0425f29-030e-498b-92a6-fe784266a262 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:57.027666 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e90be-e6db-4969-9eae-fd372e3f0dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:57.028824 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e90be-e6db-4969-9eae-fd372e3f0dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:57.029106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e90be-e6db-4969-9eae-fd372e3f0dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:57.029380 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e90be-e6db-4969-9eae-fd372e3f0dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:57.030041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e90be-e6db-4969-9eae-fd372e3f0dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:57.031983 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e90be-e6db-4969-9eae-fd372e3f0dbf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:57.057777 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1388/2768] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:56 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:57.061912 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98507304-3b74-4868-a7b3-e4aa06b5bae7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:57.072675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98507304-3b74-4868-a7b3-e4aa06b5bae7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:57.136186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca12bb8-0371-4d85-966b-83ead45fd108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:57.137006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12bb8-0371-4d85-966b-83ead45fd108 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:57.137908 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12bb8-0371-4d85-966b-83ead45fd108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:57.138235 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12bb8-0371-4d85-966b-83ead45fd108 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:57.139122 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca12bb8-0371-4d85-966b-83ead45fd108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:57.141203 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca12bb8-0371-4d85-966b-83ead45fd108 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:57.162659 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1381/2769] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:57 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:57.166654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e90be-e6db-4969-9eae-fd372e3f0dbf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:57.176849 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e90be-e6db-4969-9eae-fd372e3f0dbf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:57.181476 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015384b1-5e2e-4942-903d-a2c39c5bf5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:57.182077 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015384b1-5e2e-4942-903d-a2c39c5bf5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:57.182387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015384b1-5e2e-4942-903d-a2c39c5bf5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:57.182658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015384b1-5e2e-4942-903d-a2c39c5bf5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:57.183382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015384b1-5e2e-4942-903d-a2c39c5bf5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:57.184990 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015384b1-5e2e-4942-903d-a2c39c5bf5f0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:57.195412 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1389/2770] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:57.199428 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca12bb8-0371-4d85-966b-83ead45fd108 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:57.210841 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca12bb8-0371-4d85-966b-83ead45fd108 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:57.216177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c01144-d9a7-44a9-8717-47f243fdbc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:57.216876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c01144-d9a7-44a9-8717-47f243fdbc75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:57.217156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c01144-d9a7-44a9-8717-47f243fdbc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:57.217429 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c01144-d9a7-44a9-8717-47f243fdbc75 admin admin] PATH_INFO: `/v3/projects/f42bf5556fdb472f9def38e29a9af430/users/104b248af1034caa834fd7e35eff9756/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:57.232996 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c01144-d9a7-44a9-8717-47f243fdbc75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42bf5556fdb472f9def38e29a9af430, user_id=104b248af1034caa834fd7e35eff9756, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:57.235704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c01144-d9a7-44a9-8717-47f243fdbc75 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:57.248314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1382/2771] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:57 2022] PUT /identity/v3/projects/f42bf5556fdb472f9def38e29a9af430/users/104b248af1034caa834fd7e35eff9756/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:57.252463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015384b1-5e2e-4942-903d-a2c39c5bf5f0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:57.263227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015384b1-5e2e-4942-903d-a2c39c5bf5f0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:57.321006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82824e8b-d0e3-4f8d-bcd4-8a2ea6c92909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:57.322003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82824e8b-d0e3-4f8d-bcd4-8a2ea6c92909 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:57.322321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82824e8b-d0e3-4f8d-bcd4-8a2ea6c92909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:57.322587 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82824e8b-d0e3-4f8d-bcd4-8a2ea6c92909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:57.323577 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82824e8b-d0e3-4f8d-bcd4-8a2ea6c92909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:57.326086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82824e8b-d0e3-4f8d-bcd4-8a2ea6c92909 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:57.336241 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1390/2772] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:57.341182 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c01144-d9a7-44a9-8717-47f243fdbc75 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:57.352279 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c01144-d9a7-44a9-8717-47f243fdbc75 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:57.356586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c8ea1-f9a2-4dad-a879-3abe1b559cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:57.357252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c8ea1-f9a2-4dad-a879-3abe1b559cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:57.357531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c8ea1-f9a2-4dad-a879-3abe1b559cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:57.357800 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c8ea1-f9a2-4dad-a879-3abe1b559cd4 admin admin] PATH_INFO: `/v3/projects/f42bf5556fdb472f9def38e29a9af430/users/104b248af1034caa834fd7e35eff9756/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:57.359939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c8ea1-f9a2-4dad-a879-3abe1b559cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42bf5556fdb472f9def38e29a9af430, user_id=104b248af1034caa834fd7e35eff9756, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:57.362660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c8ea1-f9a2-4dad-a879-3abe1b559cd4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:57.374216 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1383/2773] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:57 2022] PUT /identity/v3/projects/f42bf5556fdb472f9def38e29a9af430/users/104b248af1034caa834fd7e35eff9756/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:57.385601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd06a-88db-462f-b336-7e043a7fa3d3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:57.386035 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd06a-88db-462f-b336-7e043a7fa3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:57.386316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd06a-88db-462f-b336-7e043a7fa3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:57.415742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9d2bd06a-88db-462f-b336-7e043a7fa3d3 None None] MFA Rules not processed for user `104b248af1034caa834fd7e35eff9756`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:57.416959 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9d2bd06a-88db-462f-b336-7e043a7fa3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:57.430482 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:57.503259 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1391/2774] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:57.510920 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c8ea1-f9a2-4dad-a879-3abe1b559cd4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:57.513282 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-058c8ea1-f9a2-4dad-a879-3abe1b559cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:57.575975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c8ea1-f9a2-4dad-a879-3abe1b559cd4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:57.580456 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2024c7f-79f5-43e2-a3e6-4a6e0626d0a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:57.581039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2024c7f-79f5-43e2-a3e6-4a6e0626d0a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:57.581319 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2024c7f-79f5-43e2-a3e6-4a6e0626d0a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:57.581642 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2024c7f-79f5-43e2-a3e6-4a6e0626d0a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:57.593169 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2024c7f-79f5-43e2-a3e6-4a6e0626d0a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:57.594712 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2024c7f-79f5-43e2-a3e6-4a6e0626d0a1 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:57.605860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1384/2775] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:57.987026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd06a-88db-462f-b336-7e043a7fa3d3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:58.048028 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd06a-88db-462f-b336-7e043a7fa3d3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:58.052578 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:58.053207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:58.053485 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:58.053759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] PATH_INFO: `/v3/users/91159b9635cf43bd90cefbcce6f96ae3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:58.054932 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91159b9635cf43bd90cefbcce6f96ae3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:58.056862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:58.104897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91159b9635cf43bd90cefbcce6f96ae3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.112604 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91159b9635cf43bd90cefbcce6f96ae3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.124666 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91159b9635cf43bd90cefbcce6f96ae3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.125315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91159b9635cf43bd90cefbcce6f96ae3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.132185 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91159b9635cf43bd90cefbcce6f96ae3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.138023 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1392/2776] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:57 2022] DELETE /identity/v3/users/91159b9635cf43bd90cefbcce6f96ae3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:58.142755 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d2fa8-0e20-4c27-89c1-ac03273b6dff None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:58.143009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d2fa8-0e20-4c27-89c1-ac03273b6dff None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:58.143285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d2fa8-0e20-4c27-89c1-ac03273b6dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:58.162177 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e14d2fa8-0e20-4c27-89c1-ac03273b6dff None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:58.163402 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e14d2fa8-0e20-4c27-89c1-ac03273b6dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:58.176565 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:58.222352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1385/2777] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:58.232912 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:58.234313 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:58.265807 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:58.294339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d60b7-6211-4b6c-a7d2-6d298fc3e256 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:58.298006 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8b42f-6360-4d3b-b7f9-39e326fb5c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:58.298620 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8b42f-6360-4d3b-b7f9-39e326fb5c44 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:58.298914 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8b42f-6360-4d3b-b7f9-39e326fb5c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:58.299194 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8b42f-6360-4d3b-b7f9-39e326fb5c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:58.308660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8b42f-6360-4d3b-b7f9-39e326fb5c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:58.310115 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8b42f-6360-4d3b-b7f9-39e326fb5c44 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:58.319511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1393/2778] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:01:58.599411 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d2fa8-0e20-4c27-89c1-ac03273b6dff None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:58.600911 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e14d2fa8-0e20-4c27-89c1-ac03273b6dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:58.614415 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d2fa8-0e20-4c27-89c1-ac03273b6dff None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:58.619689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:58.620347 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:58.620632 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:58.620902 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] PATH_INFO: `/v3/projects/9f711115126c4970b7da1b8c7ca1df13` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:58.622082 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f711115126c4970b7da1b8c7ca1df13)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:58.624174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:58.675747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f711115126c4970b7da1b8c7ca1df13', 'request_id': 'req-215a462b-71bc-418a-a8b9-514d35ab373f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.683678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f711115126c4970b7da1b8c7ca1df13', 'request_id': 'req-215a462b-71bc-418a-a8b9-514d35ab373f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.690363 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f711115126c4970b7da1b8c7ca1df13', 'request_id': 'req-215a462b-71bc-418a-a8b9-514d35ab373f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.707159 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] The token cache is being invalidate because project 9f711115126c4970b7da1b8c7ca1df13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:58.707571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.708391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.710484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1386/2779] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:58 2022] DELETE /identity/v3/projects/9f711115126c4970b7da1b8c7ca1df13 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:58.714781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8b42f-6360-4d3b-b7f9-39e326fb5c44 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:58.726735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8b42f-6360-4d3b-b7f9-39e326fb5c44 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:58.791675 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:58.792353 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:58.792635 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:58.792910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] PATH_INFO: `/v3/users/104b248af1034caa834fd7e35eff9756` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:58.794310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=104b248af1034caa834fd7e35eff9756)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:58.796266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:58.849435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104b248af1034caa834fd7e35eff9756'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.857058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104b248af1034caa834fd7e35eff9756'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.871324 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104b248af1034caa834fd7e35eff9756'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.872696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104b248af1034caa834fd7e35eff9756'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.882981 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-90e7e156-6a59-4e5b-a1c8-89140ce715e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104b248af1034caa834fd7e35eff9756'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:58.890757 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1394/2780] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:01:58 2022] DELETE /identity/v3/users/104b248af1034caa834fd7e35eff9756 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:59.180300 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:59.181855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:59.196717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a462b-71bc-418a-a8b9-514d35ab373f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:59.257561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:59.258213 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.258493 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.258764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] PATH_INFO: `/v3/projects/f42bf5556fdb472f9def38e29a9af430` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.260084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42bf5556fdb472f9def38e29a9af430)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:59.262652 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:59.308937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:59.312013 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42bf5556fdb472f9def38e29a9af430', 'request_id': 'req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:59.319549 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42bf5556fdb472f9def38e29a9af430', 'request_id': 'req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:59.325734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42bf5556fdb472f9def38e29a9af430', 'request_id': 'req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:59.336813 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] The token cache is being invalidate because project f42bf5556fdb472f9def38e29a9af430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:01:59.337092 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:59.337736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f46b6f37-f0fb-4829-9cae-64aff8e54ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:01:59.339271 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1387/2781] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:01:59 2022] DELETE /identity/v3/projects/f42bf5556fdb472f9def38e29a9af430 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:59.344886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b9d32-c6f0-4c8a-bd6b-6b5670b4ab11 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.345396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b9d32-c6f0-4c8a-bd6b-6b5670b4ab11 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.345514 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b9d32-c6f0-4c8a-bd6b-6b5670b4ab11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.365024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7f4b9d32-c6f0-4c8a-bd6b-6b5670b4ab11 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:59.366217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7f4b9d32-c6f0-4c8a-bd6b-6b5670b4ab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:59.411858 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:59.428457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1395/2782] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:59.436455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adb5b1-bb84-41e7-8dac-0ffa9a6fea24 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.436737 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adb5b1-bb84-41e7-8dac-0ffa9a6fea24 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.437004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adb5b1-bb84-41e7-8dac-0ffa9a6fea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.457119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e5adb5b1-bb84-41e7-8dac-0ffa9a6fea24 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:59.458322 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e5adb5b1-bb84-41e7-8dac-0ffa9a6fea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:59.466860 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1388/2783] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:59.471217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b9d32-c6f0-4c8a-bd6b-6b5670b4ab11 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:59.481307 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b9d32-c6f0-4c8a-bd6b-6b5670b4ab11 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:59.485978 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f594098-af47-4eff-b6da-052d9e44f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:59.486657 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f594098-af47-4eff-b6da-052d9e44f269 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.487003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f594098-af47-4eff-b6da-052d9e44f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.487304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f594098-af47-4eff-b6da-052d9e44f269 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.488043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f594098-af47-4eff-b6da-052d9e44f269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:01:59.488385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f594098-af47-4eff-b6da-052d9e44f269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:59.490151 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f594098-af47-4eff-b6da-052d9e44f269 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:59.501755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1396/2784] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:01:59.506243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adb5b1-bb84-41e7-8dac-0ffa9a6fea24 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:59.516091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adb5b1-bb84-41e7-8dac-0ffa9a6fea24 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:59.520694 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686bbeb-1821-4ee0-9bb3-67c8331be7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:59.521293 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686bbeb-1821-4ee0-9bb3-67c8331be7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.521571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686bbeb-1821-4ee0-9bb3-67c8331be7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.521846 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686bbeb-1821-4ee0-9bb3-67c8331be7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.522501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686bbeb-1821-4ee0-9bb3-67c8331be7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:59.524422 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686bbeb-1821-4ee0-9bb3-67c8331be7cf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:59.553685 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1389/2785] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:01:59 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:59.557793 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f594098-af47-4eff-b6da-052d9e44f269 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:59.567809 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f594098-af47-4eff-b6da-052d9e44f269 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:59.624424 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459e532-bf68-40de-b927-e415e75a9154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:59.625032 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459e532-bf68-40de-b927-e415e75a9154 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.625457 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459e532-bf68-40de-b927-e415e75a9154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.625593 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459e532-bf68-40de-b927-e415e75a9154 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.626219 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459e532-bf68-40de-b927-e415e75a9154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:59.628154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459e532-bf68-40de-b927-e415e75a9154 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:59.650279 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1397/2786] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:01:59 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:01:59.654455 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686bbeb-1821-4ee0-9bb3-67c8331be7cf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:59.665237 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686bbeb-1821-4ee0-9bb3-67c8331be7cf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:59.669876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6490589-283e-4fa7-bc39-a250b7d58982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:59.670488 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6490589-283e-4fa7-bc39-a250b7d58982 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.670773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6490589-283e-4fa7-bc39-a250b7d58982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.671070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6490589-283e-4fa7-bc39-a250b7d58982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.671772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6490589-283e-4fa7-bc39-a250b7d58982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:59.673380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6490589-283e-4fa7-bc39-a250b7d58982 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:59.683281 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1390/2787] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:59.687764 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459e532-bf68-40de-b927-e415e75a9154 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:59.697739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459e532-bf68-40de-b927-e415e75a9154 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:59.703122 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6564e-6b8d-4301-a3e2-1f1ca7c867d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:59.703815 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6564e-6b8d-4301-a3e2-1f1ca7c867d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.704041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6564e-6b8d-4301-a3e2-1f1ca7c867d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.704396 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6564e-6b8d-4301-a3e2-1f1ca7c867d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.705200 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6564e-6b8d-4301-a3e2-1f1ca7c867d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:59.706791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6564e-6b8d-4301-a3e2-1f1ca7c867d5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:59.717679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1398/2788] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:01:59.721783 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6490589-283e-4fa7-bc39-a250b7d58982 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:59.732104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6490589-283e-4fa7-bc39-a250b7d58982 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:59.736740 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cef17-6202-433e-982a-1f28ba9bbf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:59.737395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cef17-6202-433e-982a-1f28ba9bbf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.737675 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cef17-6202-433e-982a-1f28ba9bbf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.737946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cef17-6202-433e-982a-1f28ba9bbf61 admin admin] PATH_INFO: `/v3/projects/8efa1a3aa6ae48ff80dd54c7ef1cfd96/users/53f052148b8d4fa7b3e274230f7a9a99/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.752680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cef17-6202-433e-982a-1f28ba9bbf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efa1a3aa6ae48ff80dd54c7ef1cfd96, user_id=53f052148b8d4fa7b3e274230f7a9a99, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:59.755366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cef17-6202-433e-982a-1f28ba9bbf61 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:59.769554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1391/2789] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:01:59 2022] PUT /identity/v3/projects/8efa1a3aa6ae48ff80dd54c7ef1cfd96/users/53f052148b8d4fa7b3e274230f7a9a99/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:01:59.782119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996fa4-80f1-4f3c-9fa4-59cc1f3860c8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.782422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996fa4-80f1-4f3c-9fa4-59cc1f3860c8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.782751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996fa4-80f1-4f3c-9fa4-59cc1f3860c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.810681 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-19996fa4-80f1-4f3c-9fa4-59cc1f3860c8 None None] MFA Rules not processed for user `53f052148b8d4fa7b3e274230f7a9a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:01:59.812016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-19996fa4-80f1-4f3c-9fa4-59cc1f3860c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:59.880505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1399/2790] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:01:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:01:59.891921 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cef17-6202-433e-982a-1f28ba9bbf61 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:01:59.893635 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-193cef17-6202-433e-982a-1f28ba9bbf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:01:59.949529 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cef17-6202-433e-982a-1f28ba9bbf61 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:01:59.953773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f1f2-55b5-4e7e-b7b5-2456372ddee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:01:59.954384 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f1f2-55b5-4e7e-b7b5-2456372ddee9 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:01:59.954692 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f1f2-55b5-4e7e-b7b5-2456372ddee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:01:59.955004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f1f2-55b5-4e7e-b7b5-2456372ddee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:01:59.963386 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80f1f2-55b5-4e7e-b7b5-2456372ddee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:01:59.964823 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80f1f2-55b5-4e7e-b7b5-2456372ddee9 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:01:59.974668 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1392/2791] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:01:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:03.318005 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19996fa4-80f1-4f3c-9fa4-59cc1f3860c8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:03.319434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-19996fa4-80f1-4f3c-9fa4-59cc1f3860c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:03.370459 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:03.400298 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19996fa4-80f1-4f3c-9fa4-59cc1f3860c8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:03.409310 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007bef6-a3a0-49f9-b28f-378840345742 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:03.410422 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007bef6-a3a0-49f9-b28f-378840345742 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:03.410688 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007bef6-a3a0-49f9-b28f-378840345742 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:03.411094 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007bef6-a3a0-49f9-b28f-378840345742 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:03.413388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e007bef6-a3a0-49f9-b28f-378840345742 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:03.433266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007bef6-a3a0-49f9-b28f-378840345742 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:03.435372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007bef6-a3a0-49f9-b28f-378840345742 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:03.446012 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1400/2792] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:03.904219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f1f2-55b5-4e7e-b7b5-2456372ddee9 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:03.905779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0f80f1f2-55b5-4e7e-b7b5-2456372ddee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:03.971736 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f1f2-55b5-4e7e-b7b5-2456372ddee9 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:03.976700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:03.977418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:03.977721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:03.977994 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] PATH_INFO: `/v3/users/e150b321e0b84fd3944e1456ae0395a4` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:03.979268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=e150b321e0b84fd3944e1456ae0395a4)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:03.981763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:03.998006 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:04.031364 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e150b321e0b84fd3944e1456ae0395a4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.044678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e150b321e0b84fd3944e1456ae0395a4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.045344 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e150b321e0b84fd3944e1456ae0395a4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.053483 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e150b321e0b84fd3944e1456ae0395a4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.054446 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e150b321e0b84fd3944e1456ae0395a4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.068637 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1393/2793] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:02:03 2022] DELETE /identity/v3/users/e150b321e0b84fd3944e1456ae0395a4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:04.248673 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007bef6-a3a0-49f9-b28f-378840345742 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:04.266248 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007bef6-a3a0-49f9-b28f-378840345742 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:04.327117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:04.327773 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:04.328024 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:04.328296 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] PATH_INFO: `/v3/projects/e1af7dd8e62144a6a1dba863af2868e3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:04.329487 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1af7dd8e62144a6a1dba863af2868e3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:04.331437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:04.378708 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1af7dd8e62144a6a1dba863af2868e3', 'request_id': 'req-c49dcb85-6396-460c-ac98-84df31713ae1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.386088 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1af7dd8e62144a6a1dba863af2868e3', 'request_id': 'req-c49dcb85-6396-460c-ac98-84df31713ae1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.391536 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1af7dd8e62144a6a1dba863af2868e3', 'request_id': 'req-c49dcb85-6396-460c-ac98-84df31713ae1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.403382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] The token cache is being invalidate because project e1af7dd8e62144a6a1dba863af2868e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:02:04.403662 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.404283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.405778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1401/2794] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:02:04 2022] DELETE /identity/v3/projects/e1af7dd8e62144a6a1dba863af2868e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:04.409952 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:04.411395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:04.429838 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e266ad-0aea-460f-be47-4263c1c59dde admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:04.489180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:04.489822 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:04.490105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:04.490378 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] PATH_INFO: `/v3/users/835bb870bd274e2f81068d2f67c27583` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:04.491588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] RBAC: Authorizing `identity:delete_user(user_id=835bb870bd274e2f81068d2f67c27583)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:04.493513 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:04.539000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835bb870bd274e2f81068d2f67c27583'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.550760 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835bb870bd274e2f81068d2f67c27583'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.551494 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835bb870bd274e2f81068d2f67c27583'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.558822 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835bb870bd274e2f81068d2f67c27583'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.559482 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c21703d2-d06a-44ef-aeb2-9952b3c7481e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835bb870bd274e2f81068d2f67c27583'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.571535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1394/2795] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:02:04 2022] DELETE /identity/v3/users/835bb870bd274e2f81068d2f67c27583 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:04.748330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:04.749767 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:04.762925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dcb85-6396-460c-ac98-84df31713ae1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:04.822903 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:04.823554 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:04.823832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:04.824104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] PATH_INFO: `/v3/projects/29167f3023444600809220ae7ca738ff` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:04.825737 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=29167f3023444600809220ae7ca738ff)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:04.827857 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:04.835632 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:04.877571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29167f3023444600809220ae7ca738ff', 'request_id': 'req-223aa912-bccd-4614-96e6-583b79031d4d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.885168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29167f3023444600809220ae7ca738ff', 'request_id': 'req-223aa912-bccd-4614-96e6-583b79031d4d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.891504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29167f3023444600809220ae7ca738ff', 'request_id': 'req-223aa912-bccd-4614-96e6-583b79031d4d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.903108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] The token cache is being invalidate because project 29167f3023444600809220ae7ca738ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:02:04.903397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.904050 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-223aa912-bccd-4614-96e6-583b79031d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:04.905597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1402/2796] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:02:04 2022] DELETE /identity/v3/projects/29167f3023444600809220ae7ca738ff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:02:04.910625 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63fb2a-4ac0-4e2c-90e7-a38438dd26f1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:04.911156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63fb2a-4ac0-4e2c-90e7-a38438dd26f1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:04.911255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63fb2a-4ac0-4e2c-90e7-a38438dd26f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:04.931430 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8f63fb2a-4ac0-4e2c-90e7-a38438dd26f1 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:04.932655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8f63fb2a-4ac0-4e2c-90e7-a38438dd26f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:04.938631 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:04.993869 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1395/2797] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:02:05.002027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f6e9b-1d15-451b-bcac-9577f46983fc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.002315 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f6e9b-1d15-451b-bcac-9577f46983fc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.002589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f6e9b-1d15-451b-bcac-9577f46983fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.022825 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7b2f6e9b-1d15-451b-bcac-9577f46983fc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:05.024097 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7b2f6e9b-1d15-451b-bcac-9577f46983fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:05.032104 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1403/2798] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:05.036348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63fb2a-4ac0-4e2c-90e7-a38438dd26f1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:05.046059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63fb2a-4ac0-4e2c-90e7-a38438dd26f1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:05.050656 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ae418-1666-4f84-9167-ea55c0bc831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:05.051294 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ae418-1666-4f84-9167-ea55c0bc831a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.051579 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ae418-1666-4f84-9167-ea55c0bc831a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.051850 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ae418-1666-4f84-9167-ea55c0bc831a admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.052553 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ae418-1666-4f84-9167-ea55c0bc831a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:02:05.052855 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ae418-1666-4f84-9167-ea55c0bc831a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:05.054452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ae418-1666-4f84-9167-ea55c0bc831a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:05.066296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1396/2799] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:02:05.070638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f6e9b-1d15-451b-bcac-9577f46983fc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:05.081075 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f6e9b-1d15-451b-bcac-9577f46983fc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:05.085886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd453f6-b4d8-4e53-87c2-055685609de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:05.086505 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd453f6-b4d8-4e53-87c2-055685609de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.086781 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd453f6-b4d8-4e53-87c2-055685609de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.087083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd453f6-b4d8-4e53-87c2-055685609de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.087745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd453f6-b4d8-4e53-87c2-055685609de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:05.089643 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd453f6-b4d8-4e53-87c2-055685609de8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:05.126211 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1404/2800] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:02:05 2022] POST /identity/v3/projects => generated 361 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:05.129798 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ae418-1666-4f84-9167-ea55c0bc831a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:05.140533 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ae418-1666-4f84-9167-ea55c0bc831a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:05.198307 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057eebf-b492-465a-89bd-c497db2d2427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:05.198949 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057eebf-b492-465a-89bd-c497db2d2427 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.199233 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057eebf-b492-465a-89bd-c497db2d2427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.200189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057eebf-b492-465a-89bd-c497db2d2427 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.200877 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057eebf-b492-465a-89bd-c497db2d2427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:05.202787 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057eebf-b492-465a-89bd-c497db2d2427 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:05.224700 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1397/2801] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:02:05 2022] POST /identity/v3/users => generated 281 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:05.228886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd453f6-b4d8-4e53-87c2-055685609de8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:05.239713 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd453f6-b4d8-4e53-87c2-055685609de8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:05.245041 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b2a2-de92-4ce2-8143-dc5c667ac2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:05.245656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b2a2-de92-4ce2-8143-dc5c667ac2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.246027 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b2a2-de92-4ce2-8143-dc5c667ac2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.247045 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b2a2-de92-4ce2-8143-dc5c667ac2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.248031 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119b2a2-de92-4ce2-8143-dc5c667ac2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:05.249622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119b2a2-de92-4ce2-8143-dc5c667ac2f3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:05.260154 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1405/2802] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:05.264191 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057eebf-b492-465a-89bd-c497db2d2427 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:05.274353 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057eebf-b492-465a-89bd-c497db2d2427 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:05.279081 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aa341-300b-4e89-a75e-d02c197bf225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:05.279690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aa341-300b-4e89-a75e-d02c197bf225 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.279971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aa341-300b-4e89-a75e-d02c197bf225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.280244 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aa341-300b-4e89-a75e-d02c197bf225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.280939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96aa341-300b-4e89-a75e-d02c197bf225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:05.282538 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96aa341-300b-4e89-a75e-d02c197bf225 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:05.293717 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1398/2803] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:05.297897 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b2a2-de92-4ce2-8143-dc5c667ac2f3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:05.308016 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b2a2-de92-4ce2-8143-dc5c667ac2f3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:05.313285 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a0d4e-bba8-4028-b163-5d73d0898ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:05.313944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a0d4e-bba8-4028-b163-5d73d0898ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.314226 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a0d4e-bba8-4028-b163-5d73d0898ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.314502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a0d4e-bba8-4028-b163-5d73d0898ac8 admin admin] PATH_INFO: `/v3/projects/f4638c9fc36c4aa182cd38e92c039ac5/users/e9c9668a6aa940669f681b983219090f/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.330472 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a0d4e-bba8-4028-b163-5d73d0898ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4638c9fc36c4aa182cd38e92c039ac5, user_id=e9c9668a6aa940669f681b983219090f, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:05.333227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a0d4e-bba8-4028-b163-5d73d0898ac8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:05.345819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1406/2804] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:02:05 2022] PUT /identity/v3/projects/f4638c9fc36c4aa182cd38e92c039ac5/users/e9c9668a6aa940669f681b983219090f/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:05.356868 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aa78f-a4db-4ed2-82d3-ac05d6ea8b18 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.357161 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aa78f-a4db-4ed2-82d3-ac05d6ea8b18 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.357436 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aa78f-a4db-4ed2-82d3-ac05d6ea8b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.385202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4c7aa78f-a4db-4ed2-82d3-ac05d6ea8b18 None None] MFA Rules not processed for user `e9c9668a6aa940669f681b983219090f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:05.386357 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4c7aa78f-a4db-4ed2-82d3-ac05d6ea8b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:05.450910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1399/2805] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:05.484887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a0d4e-bba8-4028-b163-5d73d0898ac8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:05.486451 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-679a0d4e-bba8-4028-b163-5d73d0898ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:05.545650 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a0d4e-bba8-4028-b163-5d73d0898ac8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:05.549369 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b91f4-2948-41e5-ae00-b1b98cf1d469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:05.549980 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b91f4-2948-41e5-ae00-b1b98cf1d469 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.550261 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b91f4-2948-41e5-ae00-b1b98cf1d469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.550540 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b91f4-2948-41e5-ae00-b1b98cf1d469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.558678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b91f4-2948-41e5-ae00-b1b98cf1d469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:05.560783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b91f4-2948-41e5-ae00-b1b98cf1d469 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:05.569522 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1407/2806] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:05.584979 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aa78f-a4db-4ed2-82d3-ac05d6ea8b18 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:05.594171 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:05.650369 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aa78f-a4db-4ed2-82d3-ac05d6ea8b18 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:05.655592 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:05.656286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.656545 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.656825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] PATH_INFO: `/v3/users/e9c9668a6aa940669f681b983219090f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.658045 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c9668a6aa940669f681b983219090f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:05.660003 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:05.708012 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c9668a6aa940669f681b983219090f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:05.720646 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c9668a6aa940669f681b983219090f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:05.721314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c9668a6aa940669f681b983219090f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:05.728910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c9668a6aa940669f681b983219090f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:05.729704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c9668a6aa940669f681b983219090f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:05.742376 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1400/2807] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:02:05 2022] DELETE /identity/v3/users/e9c9668a6aa940669f681b983219090f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:05.747095 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc9733-641c-4192-aa62-0954850cf303 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.747389 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc9733-641c-4192-aa62-0954850cf303 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.747660 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc9733-641c-4192-aa62-0954850cf303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.766280 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b0dc9733-641c-4192-aa62-0954850cf303 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:05.767568 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b0dc9733-641c-4192-aa62-0954850cf303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:05.797469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:05.827854 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1408/2808] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:05.837728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:05.839215 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:05.898527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0606f-6c2d-4fc9-990c-f96bfc2a16d5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:05.902289 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e44bb-3d95-4c96-a2a6-9336311c05f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:05.903374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e44bb-3d95-4c96-a2a6-9336311c05f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:05.903650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e44bb-3d95-4c96-a2a6-9336311c05f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:05.903917 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e44bb-3d95-4c96-a2a6-9336311c05f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:05.913118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e44bb-3d95-4c96-a2a6-9336311c05f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:05.914628 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e44bb-3d95-4c96-a2a6-9336311c05f2 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:05.924974 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1401/2809] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:06.205654 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc9733-641c-4192-aa62-0954850cf303 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:06.207184 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b0dc9733-641c-4192-aa62-0954850cf303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:06.220488 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc9733-641c-4192-aa62-0954850cf303 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:06.225373 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:06.226107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.226450 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.226788 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] PATH_INFO: `/v3/projects/f4638c9fc36c4aa182cd38e92c039ac5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.228048 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4638c9fc36c4aa182cd38e92c039ac5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:06.230036 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:06.278851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4638c9fc36c4aa182cd38e92c039ac5', 'request_id': 'req-b2d9ce83-344e-4fd4-b143-51f779c86cab'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:06.286728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4638c9fc36c4aa182cd38e92c039ac5', 'request_id': 'req-b2d9ce83-344e-4fd4-b143-51f779c86cab'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:06.292363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4638c9fc36c4aa182cd38e92c039ac5', 'request_id': 'req-b2d9ce83-344e-4fd4-b143-51f779c86cab'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:06.303667 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] The token cache is being invalidate because project f4638c9fc36c4aa182cd38e92c039ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:02:06.303985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:06.304640 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2d9ce83-344e-4fd4-b143-51f779c86cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:06.306199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1409/2810] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:02:06 2022] DELETE /identity/v3/projects/f4638c9fc36c4aa182cd38e92c039ac5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:06.311145 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd2790-d88c-4b61-a0ab-847ba31b47ad None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.311437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd2790-d88c-4b61-a0ab-847ba31b47ad None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.311709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd2790-d88c-4b61-a0ab-847ba31b47ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.332531 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0cbd2790-d88c-4b61-a0ab-847ba31b47ad None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:06.333749 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0cbd2790-d88c-4b61-a0ab-847ba31b47ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:06.359143 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:06.395810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1402/2811] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:06.404977 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca0331-dd62-4c38-9a74-b13d487b045f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.405462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca0331-dd62-4c38-9a74-b13d487b045f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.405581 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca0331-dd62-4c38-9a74-b13d487b045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.425524 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d9ca0331-dd62-4c38-9a74-b13d487b045f None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:06.426749 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d9ca0331-dd62-4c38-9a74-b13d487b045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:06.435493 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1410/2812] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:06.439763 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd2790-d88c-4b61-a0ab-847ba31b47ad None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:06.450447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd2790-d88c-4b61-a0ab-847ba31b47ad None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:06.455138 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6af66-af74-4c79-a6b9-0a8d2a574dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:06.455768 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6af66-af74-4c79-a6b9-0a8d2a574dad admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.456033 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6af66-af74-4c79-a6b9-0a8d2a574dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.456305 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6af66-af74-4c79-a6b9-0a8d2a574dad admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.457009 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6af66-af74-4c79-a6b9-0a8d2a574dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:02:06.457314 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6af66-af74-4c79-a6b9-0a8d2a574dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:06.458910 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6af66-af74-4c79-a6b9-0a8d2a574dad admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:06.470537 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1403/2813] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:02:06.475114 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca0331-dd62-4c38-9a74-b13d487b045f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:06.484434 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca0331-dd62-4c38-9a74-b13d487b045f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:06.489082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba857-2fa0-47e1-821e-f77e931b03db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:06.489678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba857-2fa0-47e1-821e-f77e931b03db admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.489952 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba857-2fa0-47e1-821e-f77e931b03db admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.490218 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba857-2fa0-47e1-821e-f77e931b03db admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.490896 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ba857-2fa0-47e1-821e-f77e931b03db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:06.492787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ba857-2fa0-47e1-821e-f77e931b03db admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:06.520287 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1411/2814] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:02:06 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:06.524464 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6af66-af74-4c79-a6b9-0a8d2a574dad admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:06.534474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6af66-af74-4c79-a6b9-0a8d2a574dad admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:06.589825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fb05c-0322-406d-92c4-fae96369ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:06.590443 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb05c-0322-406d-92c4-fae96369ae4e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.590723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb05c-0322-406d-92c4-fae96369ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.591026 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb05c-0322-406d-92c4-fae96369ae4e admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.591728 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fb05c-0322-406d-92c4-fae96369ae4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:06.593646 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fb05c-0322-406d-92c4-fae96369ae4e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:06.614967 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1404/2815] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:02:06 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:02:06.619131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba857-2fa0-47e1-821e-f77e931b03db admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:06.629965 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba857-2fa0-47e1-821e-f77e931b03db admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:06.634649 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d0c0d-4643-42fd-97ca-2ae46f98695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:06.635301 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d0c0d-4643-42fd-97ca-2ae46f98695e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.635579 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d0c0d-4643-42fd-97ca-2ae46f98695e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.635852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d0c0d-4643-42fd-97ca-2ae46f98695e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.636549 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d0c0d-4643-42fd-97ca-2ae46f98695e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:06.638754 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d0c0d-4643-42fd-97ca-2ae46f98695e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:06.648842 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1412/2816] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:02:06.652726 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fb05c-0322-406d-92c4-fae96369ae4e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:06.662862 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fb05c-0322-406d-92c4-fae96369ae4e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:06.667498 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986c8f5-889c-4571-85da-783a6f7e0ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:06.668110 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986c8f5-889c-4571-85da-783a6f7e0ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.668390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986c8f5-889c-4571-85da-783a6f7e0ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.668663 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986c8f5-889c-4571-85da-783a6f7e0ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.669356 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986c8f5-889c-4571-85da-783a6f7e0ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:06.671255 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986c8f5-889c-4571-85da-783a6f7e0ba9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:06.682395 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1405/2817] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:06.686925 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d0c0d-4643-42fd-97ca-2ae46f98695e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:06.697263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d0c0d-4643-42fd-97ca-2ae46f98695e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:06.702810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9deb3-0c49-4fcb-abd5-a822655912fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:06.703508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9deb3-0c49-4fcb-abd5-a822655912fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.703786 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9deb3-0c49-4fcb-abd5-a822655912fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.704182 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9deb3-0c49-4fcb-abd5-a822655912fa admin admin] PATH_INFO: `/v3/projects/057a054324cc4307b9bd69fddb928dab/users/bf5c7fa61d5c4e88a0897cc5007cad93/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.718651 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9deb3-0c49-4fcb-abd5-a822655912fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=057a054324cc4307b9bd69fddb928dab, user_id=bf5c7fa61d5c4e88a0897cc5007cad93, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:06.721339 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9deb3-0c49-4fcb-abd5-a822655912fa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:06.736371 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1413/2818] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:02:06 2022] PUT /identity/v3/projects/057a054324cc4307b9bd69fddb928dab/users/bf5c7fa61d5c4e88a0897cc5007cad93/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:06.747623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c370-7f9e-4638-8eb7-055471df580d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.747906 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c370-7f9e-4638-8eb7-055471df580d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.748173 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c370-7f9e-4638-8eb7-055471df580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.776232 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3d44c370-7f9e-4638-8eb7-055471df580d None None] MFA Rules not processed for user `bf5c7fa61d5c4e88a0897cc5007cad93`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:06.777481 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3d44c370-7f9e-4638-8eb7-055471df580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:06.845672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1406/2819] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:06.857702 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9deb3-0c49-4fcb-abd5-a822655912fa admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:06.859449 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a2d9deb3-0c49-4fcb-abd5-a822655912fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:06.917082 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9deb3-0c49-4fcb-abd5-a822655912fa admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:06.921217 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f6e8f-dde9-4718-b97d-fa92ed1f7a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:06.921834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6e8f-dde9-4718-b97d-fa92ed1f7a23 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:06.922118 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6e8f-dde9-4718-b97d-fa92ed1f7a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:06.922397 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6e8f-dde9-4718-b97d-fa92ed1f7a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:06.930563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f6e8f-dde9-4718-b97d-fa92ed1f7a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:06.932113 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f6e8f-dde9-4718-b97d-fa92ed1f7a23 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:06.936289 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:06.943665 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1414/2820] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:12.566238 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44c370-7f9e-4638-8eb7-055471df580d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:12.567803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3d44c370-7f9e-4638-8eb7-055471df580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:12.595879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:12.637954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44c370-7f9e-4638-8eb7-055471df580d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:12.643048 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:12.643961 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:12.644267 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:12.644546 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] PATH_INFO: `/v3/users/53f052148b8d4fa7b3e274230f7a9a99` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:12.646034 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f052148b8d4fa7b3e274230f7a9a99)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:12.648047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:12.695025 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f052148b8d4fa7b3e274230f7a9a99'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:12.706664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f052148b8d4fa7b3e274230f7a9a99'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:12.707375 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f052148b8d4fa7b3e274230f7a9a99'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:12.716437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f052148b8d4fa7b3e274230f7a9a99'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:12.717096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f052148b8d4fa7b3e274230f7a9a99'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:12.732107 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1407/2821] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:02:12 2022] DELETE /identity/v3/users/53f052148b8d4fa7b3e274230f7a9a99 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:12.736677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013e5f-df3a-4ba7-9777-986d82b0c0e6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:12.737192 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013e5f-df3a-4ba7-9777-986d82b0c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:12.737300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013e5f-df3a-4ba7-9777-986d82b0c0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:12.756096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0a013e5f-df3a-4ba7-9777-986d82b0c0e6 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:12.757314 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0a013e5f-df3a-4ba7-9777-986d82b0c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:12.819631 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1415/2822] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:12.829778 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:12.831516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:12.892027 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203955d-3abd-481e-b7c4-15444f000973 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:12.895826 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d016b18-daa6-4dfe-a471-c4629cff9c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:12.896452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d016b18-daa6-4dfe-a471-c4629cff9c0d service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:12.896734 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d016b18-daa6-4dfe-a471-c4629cff9c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:12.897004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d016b18-daa6-4dfe-a471-c4629cff9c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:12.907139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d016b18-daa6-4dfe-a471-c4629cff9c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:12.908600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d016b18-daa6-4dfe-a471-c4629cff9c0d service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:12.918672 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1408/2823] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:13.236202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013e5f-df3a-4ba7-9777-986d82b0c0e6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:13.238170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0a013e5f-df3a-4ba7-9777-986d82b0c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:13.253144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013e5f-df3a-4ba7-9777-986d82b0c0e6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:13.258098 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:13.258739 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.259049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.259325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] PATH_INFO: `/v3/projects/8efa1a3aa6ae48ff80dd54c7ef1cfd96` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.260539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efa1a3aa6ae48ff80dd54c7ef1cfd96)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:13.263145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:13.312742 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efa1a3aa6ae48ff80dd54c7ef1cfd96', 'request_id': 'req-3328826a-19cc-4190-a5a2-c8559079c965'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:13.320201 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efa1a3aa6ae48ff80dd54c7ef1cfd96', 'request_id': 'req-3328826a-19cc-4190-a5a2-c8559079c965'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:13.326526 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efa1a3aa6ae48ff80dd54c7ef1cfd96', 'request_id': 'req-3328826a-19cc-4190-a5a2-c8559079c965'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:13.337699 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] The token cache is being invalidate because project 8efa1a3aa6ae48ff80dd54c7ef1cfd96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:02:13.337984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:13.338622 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3328826a-19cc-4190-a5a2-c8559079c965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:13.340197 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1416/2824] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:02:13 2022] DELETE /identity/v3/projects/8efa1a3aa6ae48ff80dd54c7ef1cfd96 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:13.345060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9691b-9951-4587-b800-c713fe12a5dc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.345351 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9691b-9951-4587-b800-c713fe12a5dc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.345630 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9691b-9951-4587-b800-c713fe12a5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.365648 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e7c9691b-9951-4587-b800-c713fe12a5dc None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:13.366865 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e7c9691b-9951-4587-b800-c713fe12a5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:13.409102 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:13.433622 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1409/2825] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:13.441576 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01db78-32ef-4774-bf9b-17286b36b986 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.441889 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01db78-32ef-4774-bf9b-17286b36b986 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.442170 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01db78-32ef-4774-bf9b-17286b36b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.463843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8c01db78-32ef-4774-bf9b-17286b36b986 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:13.465131 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8c01db78-32ef-4774-bf9b-17286b36b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:13.473382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1417/2826] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:13.478252 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9691b-9951-4587-b800-c713fe12a5dc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:13.489404 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9691b-9951-4587-b800-c713fe12a5dc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:13.494360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b209531-f8bc-412b-9acf-12fb33ccaf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:13.495001 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b209531-f8bc-412b-9acf-12fb33ccaf73 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.495281 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b209531-f8bc-412b-9acf-12fb33ccaf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.495550 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b209531-f8bc-412b-9acf-12fb33ccaf73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.496241 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b209531-f8bc-412b-9acf-12fb33ccaf73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:02:13.497076 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b209531-f8bc-412b-9acf-12fb33ccaf73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:13.498658 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b209531-f8bc-412b-9acf-12fb33ccaf73 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:13.510129 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1410/2827] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:02:13.514408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01db78-32ef-4774-bf9b-17286b36b986 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:13.526273 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01db78-32ef-4774-bf9b-17286b36b986 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:13.531271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ecc7c-0e8c-4ef2-957b-c2caef7fc975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:13.532081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ecc7c-0e8c-4ef2-957b-c2caef7fc975 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.532508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ecc7c-0e8c-4ef2-957b-c2caef7fc975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.532992 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ecc7c-0e8c-4ef2-957b-c2caef7fc975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.533909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ecc7c-0e8c-4ef2-957b-c2caef7fc975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:13.536294 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ecc7c-0e8c-4ef2-957b-c2caef7fc975 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:13.571022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1418/2828] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:02:13 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:02:13.575762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b209531-f8bc-412b-9acf-12fb33ccaf73 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:13.586229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b209531-f8bc-412b-9acf-12fb33ccaf73 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:13.648150 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f58ef-6432-4fcd-8e42-05dd0ba8d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:13.648775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f58ef-6432-4fcd-8e42-05dd0ba8d3ad admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.649056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f58ef-6432-4fcd-8e42-05dd0ba8d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.649330 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f58ef-6432-4fcd-8e42-05dd0ba8d3ad admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.650008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f58ef-6432-4fcd-8e42-05dd0ba8d3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:13.651984 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f58ef-6432-4fcd-8e42-05dd0ba8d3ad admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:13.679174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1411/2829] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:02:13 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:13.680382 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ecc7c-0e8c-4ef2-957b-c2caef7fc975 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:13.691508 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ecc7c-0e8c-4ef2-957b-c2caef7fc975 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:13.696271 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fde6b-da39-4208-abb6-d57d7d1886cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:13.696906 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fde6b-da39-4208-abb6-d57d7d1886cb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.697181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fde6b-da39-4208-abb6-d57d7d1886cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.697452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fde6b-da39-4208-abb6-d57d7d1886cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.698144 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fde6b-da39-4208-abb6-d57d7d1886cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:13.699806 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fde6b-da39-4208-abb6-d57d7d1886cb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:13.711862 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1419/2830] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:13.715876 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f58ef-6432-4fcd-8e42-05dd0ba8d3ad admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:13.726930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f58ef-6432-4fcd-8e42-05dd0ba8d3ad admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:13.732286 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6f23c-3fb5-4a17-99c6-5586bf9d9cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:13.732816 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6f23c-3fb5-4a17-99c6-5586bf9d9cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.733093 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6f23c-3fb5-4a17-99c6-5586bf9d9cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.733366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6f23c-3fb5-4a17-99c6-5586bf9d9cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.734058 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6f23c-3fb5-4a17-99c6-5586bf9d9cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:13.735690 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6f23c-3fb5-4a17-99c6-5586bf9d9cd3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:13.749119 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1412/2831] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:13.753352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fde6b-da39-4208-abb6-d57d7d1886cb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:13.763677 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fde6b-da39-4208-abb6-d57d7d1886cb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:13.768408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6f31e-e82e-48ef-9541-a8f9053c3d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:13.769096 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6f31e-e82e-48ef-9541-a8f9053c3d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.769364 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6f31e-e82e-48ef-9541-a8f9053c3d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.769738 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6f31e-e82e-48ef-9541-a8f9053c3d8f admin admin] PATH_INFO: `/v3/projects/35abd6ab595f4bbcb8c0d174d2d2a36e/users/d9c1b007ad004ddd97bb294f974e0673/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.785107 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6f31e-e82e-48ef-9541-a8f9053c3d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35abd6ab595f4bbcb8c0d174d2d2a36e, user_id=d9c1b007ad004ddd97bb294f974e0673, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:13.788040 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6f31e-e82e-48ef-9541-a8f9053c3d8f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:13.803873 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1420/2832] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:02:13 2022] PUT /identity/v3/projects/35abd6ab595f4bbcb8c0d174d2d2a36e/users/d9c1b007ad004ddd97bb294f974e0673/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:13.815407 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d376ae-57e8-4f2f-a85c-6e5791227e6f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:13.815704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d376ae-57e8-4f2f-a85c-6e5791227e6f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:13.815975 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d376ae-57e8-4f2f-a85c-6e5791227e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:13.846845 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-48d376ae-57e8-4f2f-a85c-6e5791227e6f None None] MFA Rules not processed for user `d9c1b007ad004ddd97bb294f974e0673`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:13.848234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-48d376ae-57e8-4f2f-a85c-6e5791227e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:13.924437 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1413/2833] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:13.929190 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6f31e-e82e-48ef-9541-a8f9053c3d8f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:13.953274 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:14.000496 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6f31e-e82e-48ef-9541-a8f9053c3d8f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.005130 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afae576-f8b6-44d6-bf03-1ae8db75e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.005746 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afae576-f8b6-44d6-bf03-1ae8db75e50d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.006026 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afae576-f8b6-44d6-bf03-1ae8db75e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.006299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afae576-f8b6-44d6-bf03-1ae8db75e50d admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.006985 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afae576-f8b6-44d6-bf03-1ae8db75e50d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.008883 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afae576-f8b6-44d6-bf03-1ae8db75e50d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.036728 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1421/2834] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:02:13 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:14.040818 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d376ae-57e8-4f2f-a85c-6e5791227e6f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.053178 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d376ae-57e8-4f2f-a85c-6e5791227e6f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.094836 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:14.112922 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf07af-9a17-4035-82bd-a596c05ba75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.113544 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf07af-9a17-4035-82bd-a596c05ba75e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.113830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf07af-9a17-4035-82bd-a596c05ba75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.114096 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf07af-9a17-4035-82bd-a596c05ba75e admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.114758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf07af-9a17-4035-82bd-a596c05ba75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.116708 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf07af-9a17-4035-82bd-a596c05ba75e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.138371 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1414/2835] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:02:14 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:14.142304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afae576-f8b6-44d6-bf03-1ae8db75e50d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.153179 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afae576-f8b6-44d6-bf03-1ae8db75e50d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.157783 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c755cb-75dc-4794-b6d4-9ad8aa992c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.158385 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c755cb-75dc-4794-b6d4-9ad8aa992c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.158664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c755cb-75dc-4794-b6d4-9ad8aa992c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.158967 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c755cb-75dc-4794-b6d4-9ad8aa992c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.159658 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c755cb-75dc-4794-b6d4-9ad8aa992c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.161237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c755cb-75dc-4794-b6d4-9ad8aa992c1d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.172584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1422/2836] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:14.176937 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf07af-9a17-4035-82bd-a596c05ba75e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.188650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf07af-9a17-4035-82bd-a596c05ba75e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.193331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850940f0-f350-453d-bcb5-463badd50166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.193954 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850940f0-f350-453d-bcb5-463badd50166 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.194366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850940f0-f350-453d-bcb5-463badd50166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.194491 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850940f0-f350-453d-bcb5-463badd50166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.195227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850940f0-f350-453d-bcb5-463badd50166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.196812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850940f0-f350-453d-bcb5-463badd50166 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.208030 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1415/2837] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:14.215697 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c755cb-75dc-4794-b6d4-9ad8aa992c1d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.226765 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c755cb-75dc-4794-b6d4-9ad8aa992c1d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.232248 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e9845-d781-455a-9362-e0b0f5cd4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.232917 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e9845-d781-455a-9362-e0b0f5cd4a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.233343 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e9845-d781-455a-9362-e0b0f5cd4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.233590 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e9845-d781-455a-9362-e0b0f5cd4a9f admin admin] PATH_INFO: `/v3/projects/276f8910d47a47fb9a9ed0ac2889e41e/users/3b8ca50181054f14bfffeb083a78b8cd/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.249887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e9845-d781-455a-9362-e0b0f5cd4a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=276f8910d47a47fb9a9ed0ac2889e41e, user_id=3b8ca50181054f14bfffeb083a78b8cd, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.252649 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e9845-d781-455a-9362-e0b0f5cd4a9f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.266525 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1423/2838] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:02:14 2022] PUT /identity/v3/projects/276f8910d47a47fb9a9ed0ac2889e41e/users/3b8ca50181054f14bfffeb083a78b8cd/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:02:14.337189 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5cbb-393f-4986-aa9d-150177c2f2b3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.337595 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5cbb-393f-4986-aa9d-150177c2f2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.337962 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5cbb-393f-4986-aa9d-150177c2f2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.367331 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-24ba5cbb-393f-4986-aa9d-150177c2f2b3 None None] MFA Rules not processed for user `3b8ca50181054f14bfffeb083a78b8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:14.368555 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-24ba5cbb-393f-4986-aa9d-150177c2f2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:14.434180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1416/2839] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:14.438864 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e9845-d781-455a-9362-e0b0f5cd4a9f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.501813 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e9845-d781-455a-9362-e0b0f5cd4a9f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.506679 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010f80-7cf5-4497-89ec-2b234430c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.507262 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010f80-7cf5-4497-89ec-2b234430c73a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.507543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010f80-7cf5-4497-89ec-2b234430c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.507814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010f80-7cf5-4497-89ec-2b234430c73a admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.508477 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010f80-7cf5-4497-89ec-2b234430c73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.510377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010f80-7cf5-4497-89ec-2b234430c73a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.538138 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1424/2840] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:02:14 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:14.542101 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5cbb-393f-4986-aa9d-150177c2f2b3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.552644 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5cbb-393f-4986-aa9d-150177c2f2b3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.610810 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90681bc1-2020-4aa1-abd5-9bc956be81b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.611535 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90681bc1-2020-4aa1-abd5-9bc956be81b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.611733 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90681bc1-2020-4aa1-abd5-9bc956be81b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.612005 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90681bc1-2020-4aa1-abd5-9bc956be81b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.612680 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90681bc1-2020-4aa1-abd5-9bc956be81b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.615105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90681bc1-2020-4aa1-abd5-9bc956be81b7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.639439 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1417/2841] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:02:14 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:14.643504 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010f80-7cf5-4497-89ec-2b234430c73a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.654049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010f80-7cf5-4497-89ec-2b234430c73a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.658779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563994b7-7736-4475-a3ec-a0cf8e69b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.659445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563994b7-7736-4475-a3ec-a0cf8e69b98e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.659727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563994b7-7736-4475-a3ec-a0cf8e69b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.659999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563994b7-7736-4475-a3ec-a0cf8e69b98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.660690 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563994b7-7736-4475-a3ec-a0cf8e69b98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.662299 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563994b7-7736-4475-a3ec-a0cf8e69b98e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.672953 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1425/2842] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:14.677554 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90681bc1-2020-4aa1-abd5-9bc956be81b7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.689047 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90681bc1-2020-4aa1-abd5-9bc956be81b7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.694060 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb343a0-c5ec-42fc-bce7-f0ae6f650537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.694747 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb343a0-c5ec-42fc-bce7-f0ae6f650537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.695054 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb343a0-c5ec-42fc-bce7-f0ae6f650537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.695329 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb343a0-c5ec-42fc-bce7-f0ae6f650537 admin admin] PATH_INFO: `/v3/projects/94c5cf2d98e24e738c29d282026343ef/users/7e957bd5636b4e63aca80c9de0f5483d/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.711636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb343a0-c5ec-42fc-bce7-f0ae6f650537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c5cf2d98e24e738c29d282026343ef, user_id=7e957bd5636b4e63aca80c9de0f5483d, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.714317 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb343a0-c5ec-42fc-bce7-f0ae6f650537 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.728166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1418/2843] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:02:14 2022] PUT /identity/v3/projects/94c5cf2d98e24e738c29d282026343ef/users/7e957bd5636b4e63aca80c9de0f5483d/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:14.732469 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563994b7-7736-4475-a3ec-a0cf8e69b98e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.743956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563994b7-7736-4475-a3ec-a0cf8e69b98e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.786338 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:14.808363 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3870c-a85d-4a15-87bc-4bdf9c4a1042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.808597 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3870c-a85d-4a15-87bc-4bdf9c4a1042 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.809305 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3870c-a85d-4a15-87bc-4bdf9c4a1042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.809601 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3870c-a85d-4a15-87bc-4bdf9c4a1042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.810300 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3870c-a85d-4a15-87bc-4bdf9c4a1042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.812416 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3870c-a85d-4a15-87bc-4bdf9c4a1042 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.823876 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1426/2844] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:14.828702 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb343a0-c5ec-42fc-bce7-f0ae6f650537 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.840475 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb343a0-c5ec-42fc-bce7-f0ae6f650537 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:14.846029 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa11b00-98fd-47fc-add6-e59d7d639dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:14.846804 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa11b00-98fd-47fc-add6-e59d7d639dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.847023 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa11b00-98fd-47fc-add6-e59d7d639dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.847304 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa11b00-98fd-47fc-add6-e59d7d639dd9 admin admin] PATH_INFO: `/v3/projects/94c5cf2d98e24e738c29d282026343ef/users/7e957bd5636b4e63aca80c9de0f5483d/roles/2ba3b2926541436a9d26782420538af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.849611 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa11b00-98fd-47fc-add6-e59d7d639dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c5cf2d98e24e738c29d282026343ef, user_id=7e957bd5636b4e63aca80c9de0f5483d, role_id=2ba3b2926541436a9d26782420538af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:14.852352 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa11b00-98fd-47fc-add6-e59d7d639dd9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:14.863725 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1419/2845] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:02:14 2022] PUT /identity/v3/projects/94c5cf2d98e24e738c29d282026343ef/users/7e957bd5636b4e63aca80c9de0f5483d/roles/2ba3b2926541436a9d26782420538af3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:14.874759 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2061-3f90-4364-87ba-46c88ddaaa94 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:14.875083 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2061-3f90-4364-87ba-46c88ddaaa94 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:14.875366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2061-3f90-4364-87ba-46c88ddaaa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:14.904592 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7cbe2061-3f90-4364-87ba-46c88ddaaa94 None None] MFA Rules not processed for user `7e957bd5636b4e63aca80c9de0f5483d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:14.905818 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7cbe2061-3f90-4364-87ba-46c88ddaaa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:14.974984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1427/2846] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:14.987046 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa11b00-98fd-47fc-add6-e59d7d639dd9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:14.988863 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7aa11b00-98fd-47fc-add6-e59d7d639dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:14.994348 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:15.052262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa11b00-98fd-47fc-add6-e59d7d639dd9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:15.055878 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb328b-40d4-4542-be45-3bc3adfccae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:15.056492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb328b-40d4-4542-be45-3bc3adfccae9 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:15.056772 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb328b-40d4-4542-be45-3bc3adfccae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:15.057044 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb328b-40d4-4542-be45-3bc3adfccae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:15.112427 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb328b-40d4-4542-be45-3bc3adfccae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:15.113727 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb328b-40d4-4542-be45-3bc3adfccae9 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:15.123285 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1420/2847] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:16.624413 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe2061-3f90-4364-87ba-46c88ddaaa94 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:16.634365 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe2061-3f90-4364-87ba-46c88ddaaa94 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:16.638007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea65e3f-e21d-4ee5-b937-d83471cab977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:16.638616 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea65e3f-e21d-4ee5-b937-d83471cab977 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:16.638908 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea65e3f-e21d-4ee5-b937-d83471cab977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:16.639320 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea65e3f-e21d-4ee5-b937-d83471cab977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:16.699119 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea65e3f-e21d-4ee5-b937-d83471cab977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:16.700500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea65e3f-e21d-4ee5-b937-d83471cab977 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:16.709420 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1428/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:17.252136 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb328b-40d4-4542-be45-3bc3adfccae9 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:17.253601 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3bcb328b-40d4-4542-be45-3bc3adfccae9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:17.266699 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb328b-40d4-4542-be45-3bc3adfccae9 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:17.271806 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99addc-54bf-4115-b808-60835a0883e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:17.272484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99addc-54bf-4115-b808-60835a0883e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:17.272764 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99addc-54bf-4115-b808-60835a0883e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:17.273039 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99addc-54bf-4115-b808-60835a0883e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:17.283636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99addc-54bf-4115-b808-60835a0883e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:17.285070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99addc-54bf-4115-b808-60835a0883e8 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:17.295360 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1421/2849] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:26.705447 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=72 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:27.290731 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=53 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:31.703402 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea65e3f-e21d-4ee5-b937-d83471cab977 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:31.767129 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea65e3f-e21d-4ee5-b937-d83471cab977 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:31.771676 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:31.772311 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:31.772611 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:31.772877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] PATH_INFO: `/v3/users/d9c1b007ad004ddd97bb294f974e0673` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:31.774021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c1b007ad004ddd97bb294f974e0673)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:31.775999 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:31.821975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c1b007ad004ddd97bb294f974e0673'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:31.830186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c1b007ad004ddd97bb294f974e0673'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:31.843928 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c1b007ad004ddd97bb294f974e0673'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:31.844693 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c1b007ad004ddd97bb294f974e0673'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:31.852081 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c1b007ad004ddd97bb294f974e0673'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:31.858002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1429/2850] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:02:31 2022] DELETE /identity/v3/users/d9c1b007ad004ddd97bb294f974e0673 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:31.862512 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6167ad4-740f-4261-ba4b-9ce26fe47f2e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:31.863028 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6167ad4-740f-4261-ba4b-9ce26fe47f2e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:31.863139 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6167ad4-740f-4261-ba4b-9ce26fe47f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:31.882527 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e6167ad4-740f-4261-ba4b-9ce26fe47f2e None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:31.883825 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e6167ad4-740f-4261-ba4b-9ce26fe47f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:31.943666 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1422/2851] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:31.954019 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:31.955467 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:32.012510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa801b-c4d6-4402-ae7e-f48952313152 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:32.016853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0163-a682-44e4-bce2-da5fcb870821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:32.017462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0163-a682-44e4-bce2-da5fcb870821 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:32.017744 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0163-a682-44e4-bce2-da5fcb870821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:32.018021 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0163-a682-44e4-bce2-da5fcb870821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:32.027007 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d0163-a682-44e4-bce2-da5fcb870821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:32.028435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d0163-a682-44e4-bce2-da5fcb870821 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:32.037852 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1430/2852] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:32.311149 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6167ad4-740f-4261-ba4b-9ce26fe47f2e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:32.312774 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e6167ad4-740f-4261-ba4b-9ce26fe47f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:32.332742 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6167ad4-740f-4261-ba4b-9ce26fe47f2e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:32.341221 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:32.342088 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:32.342262 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:32.342452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] PATH_INFO: `/v3/projects/35abd6ab595f4bbcb8c0d174d2d2a36e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:32.343929 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35abd6ab595f4bbcb8c0d174d2d2a36e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:32.345566 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:32.395714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35abd6ab595f4bbcb8c0d174d2d2a36e', 'request_id': 'req-de7921ed-7ef1-484a-89ab-a5a921963d64'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.403127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35abd6ab595f4bbcb8c0d174d2d2a36e', 'request_id': 'req-de7921ed-7ef1-484a-89ab-a5a921963d64'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.408729 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35abd6ab595f4bbcb8c0d174d2d2a36e', 'request_id': 'req-de7921ed-7ef1-484a-89ab-a5a921963d64'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.420104 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] The token cache is being invalidate because project 35abd6ab595f4bbcb8c0d174d2d2a36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:02:32.420391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.421038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.422562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1423/2853] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:02:32 2022] DELETE /identity/v3/projects/35abd6ab595f4bbcb8c0d174d2d2a36e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:32.427775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0163-a682-44e4-bce2-da5fcb870821 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:32.438333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0163-a682-44e4-bce2-da5fcb870821 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:32.456659 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:32.498240 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:32.498812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:32.499117 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:32.499394 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] PATH_INFO: `/v3/users/3b8ca50181054f14bfffeb083a78b8cd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:32.500566 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8ca50181054f14bfffeb083a78b8cd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:32.502502 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:32.548609 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8ca50181054f14bfffeb083a78b8cd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.555799 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8ca50181054f14bfffeb083a78b8cd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.568283 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8ca50181054f14bfffeb083a78b8cd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.568924 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8ca50181054f14bfffeb083a78b8cd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.575846 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8ca50181054f14bfffeb083a78b8cd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.581732 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1431/2854] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:02:32 2022] DELETE /identity/v3/users/3b8ca50181054f14bfffeb083a78b8cd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:32.851610 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:32.853248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:32.867180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7921ed-7ef1-484a-89ab-a5a921963d64 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:32.926561 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:32.927239 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:32.927518 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:32.927790 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] PATH_INFO: `/v3/projects/276f8910d47a47fb9a9ed0ac2889e41e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:32.928948 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276f8910d47a47fb9a9ed0ac2889e41e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:32.930844 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:32.960709 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:32.979542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276f8910d47a47fb9a9ed0ac2889e41e', 'request_id': 'req-4af1de16-bf11-4eea-aaba-5a96563bedd9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.987126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276f8910d47a47fb9a9ed0ac2889e41e', 'request_id': 'req-4af1de16-bf11-4eea-aaba-5a96563bedd9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:32.992676 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276f8910d47a47fb9a9ed0ac2889e41e', 'request_id': 'req-4af1de16-bf11-4eea-aaba-5a96563bedd9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.003380 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] The token cache is being invalidate because project 276f8910d47a47fb9a9ed0ac2889e41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:02:33.003664 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.004296 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.005779 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1424/2855] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:02:32 2022] DELETE /identity/v3/projects/276f8910d47a47fb9a9ed0ac2889e41e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:33.009829 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:33.011360 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:33.024695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2a68a-f4fa-448f-8614-f9e0fbffa6b6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:33.081058 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:33.081696 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:33.081979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:33.082258 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] PATH_INFO: `/v3/users/7e957bd5636b4e63aca80c9de0f5483d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:33.083445 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e957bd5636b4e63aca80c9de0f5483d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:33.085374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:33.135734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:33.139001 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e957bd5636b4e63aca80c9de0f5483d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.149955 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e957bd5636b4e63aca80c9de0f5483d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.163372 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e957bd5636b4e63aca80c9de0f5483d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.164051 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e957bd5636b4e63aca80c9de0f5483d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.171404 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5894e038-eb72-4b2c-8b49-9ea94a6d8084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e957bd5636b4e63aca80c9de0f5483d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.178065 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1432/2856] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:02:33 2022] DELETE /identity/v3/users/7e957bd5636b4e63aca80c9de0f5483d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:33.455840 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:33.457577 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:33.471879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1de16-bf11-4eea-aaba-5a96563bedd9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:33.534452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:33.535118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:33.535391 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:33.535661 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] PATH_INFO: `/v3/projects/94c5cf2d98e24e738c29d282026343ef` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:33.536820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c5cf2d98e24e738c29d282026343ef)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:33.538792 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:33.584387 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c5cf2d98e24e738c29d282026343ef', 'request_id': 'req-7f5e4310-7aad-4f76-9bff-a74d216be027'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.591636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c5cf2d98e24e738c29d282026343ef', 'request_id': 'req-7f5e4310-7aad-4f76-9bff-a74d216be027'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.597242 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c5cf2d98e24e738c29d282026343ef', 'request_id': 'req-7f5e4310-7aad-4f76-9bff-a74d216be027'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.608281 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] The token cache is being invalidate because project 94c5cf2d98e24e738c29d282026343ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:02:33.608563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.609186 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7f5e4310-7aad-4f76-9bff-a74d216be027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:33.610797 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1425/2857] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:02:33 2022] DELETE /identity/v3/projects/94c5cf2d98e24e738c29d282026343ef => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:33.616598 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad6c8d-abec-4aec-ac85-4e8a77af1b80 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:33.616892 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad6c8d-abec-4aec-ac85-4e8a77af1b80 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:33.617169 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad6c8d-abec-4aec-ac85-4e8a77af1b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:33.637108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4cad6c8d-abec-4aec-ac85-4e8a77af1b80 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:33.638994 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4cad6c8d-abec-4aec-ac85-4e8a77af1b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:33.697894 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1433/2858] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:33.707896 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12baddb0-6b92-477a-8686-9786b06380ac None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:33.708184 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12baddb0-6b92-477a-8686-9786b06380ac None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:33.708458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12baddb0-6b92-477a-8686-9786b06380ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:33.729074 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-12baddb0-6b92-477a-8686-9786b06380ac None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:33.730283 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-12baddb0-6b92-477a-8686-9786b06380ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:33.738703 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1426/2859] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:33.743002 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad6c8d-abec-4aec-ac85-4e8a77af1b80 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:33.753473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad6c8d-abec-4aec-ac85-4e8a77af1b80 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:33.758072 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5688ea-8107-427b-9d67-9bb29e1774b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:33.758678 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5688ea-8107-427b-9d67-9bb29e1774b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:33.758986 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5688ea-8107-427b-9d67-9bb29e1774b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:33.759263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5688ea-8107-427b-9d67-9bb29e1774b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:33.759960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5688ea-8107-427b-9d67-9bb29e1774b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:02:33.760293 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5688ea-8107-427b-9d67-9bb29e1774b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:33.761887 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5688ea-8107-427b-9d67-9bb29e1774b8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:33.773511 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1434/2860] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:02:33.777762 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12baddb0-6b92-477a-8686-9786b06380ac None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:33.787303 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12baddb0-6b92-477a-8686-9786b06380ac None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:33.792209 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499e8aa-9e03-4ffa-9ce4-c5a7b3015ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:33.792721 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499e8aa-9e03-4ffa-9ce4-c5a7b3015ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:33.793037 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499e8aa-9e03-4ffa-9ce4-c5a7b3015ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:33.793417 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499e8aa-9e03-4ffa-9ce4-c5a7b3015ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:33.794084 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499e8aa-9e03-4ffa-9ce4-c5a7b3015ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:33.796532 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499e8aa-9e03-4ffa-9ce4-c5a7b3015ec6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:33.831123 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1427/2861] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:02:33 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:33.835470 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5688ea-8107-427b-9d67-9bb29e1774b8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:33.846264 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5688ea-8107-427b-9d67-9bb29e1774b8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:33.903810 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554436e-6965-445d-b3f8-a24fce7fd5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:33.904433 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554436e-6965-445d-b3f8-a24fce7fd5cc admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:33.904720 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554436e-6965-445d-b3f8-a24fce7fd5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:33.905561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554436e-6965-445d-b3f8-a24fce7fd5cc admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:33.906263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554436e-6965-445d-b3f8-a24fce7fd5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:33.908238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554436e-6965-445d-b3f8-a24fce7fd5cc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:33.929288 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1435/2862] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:02:33 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:02:33.933467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499e8aa-9e03-4ffa-9ce4-c5a7b3015ec6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:33.944476 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499e8aa-9e03-4ffa-9ce4-c5a7b3015ec6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:33.949181 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f5f9-fbca-401e-a552-6ba0855e5f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:33.949782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f5f9-fbca-401e-a552-6ba0855e5f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:33.950056 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f5f9-fbca-401e-a552-6ba0855e5f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:33.950326 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f5f9-fbca-401e-a552-6ba0855e5f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:33.951057 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847f5f9-fbca-401e-a552-6ba0855e5f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:33.952636 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847f5f9-fbca-401e-a552-6ba0855e5f7b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:33.962398 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1428/2863] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:33.967539 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554436e-6965-445d-b3f8-a24fce7fd5cc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:33.977785 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554436e-6965-445d-b3f8-a24fce7fd5cc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:33.982944 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ef64-9722-4ae3-8593-eddee65115a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:33.983543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ef64-9722-4ae3-8593-eddee65115a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:33.983819 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ef64-9722-4ae3-8593-eddee65115a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:33.984090 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ef64-9722-4ae3-8593-eddee65115a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:33.984778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ef64-9722-4ae3-8593-eddee65115a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:33.986354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ef64-9722-4ae3-8593-eddee65115a0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:33.996884 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1436/2864] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:34.001627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f5f9-fbca-401e-a552-6ba0855e5f7b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:34.008350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:34.012160 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f5f9-fbca-401e-a552-6ba0855e5f7b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:34.017872 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698190b2-ed72-4e5a-9328-5a1d3f05e527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:34.018741 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698190b2-ed72-4e5a-9328-5a1d3f05e527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:34.019273 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698190b2-ed72-4e5a-9328-5a1d3f05e527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:34.019645 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698190b2-ed72-4e5a-9328-5a1d3f05e527 admin admin] PATH_INFO: `/v3/projects/69f915b1210048828a2fa68d1b904519/users/432ceb18b30f46caa8e7f9e3157814e7/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:34.035133 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698190b2-ed72-4e5a-9328-5a1d3f05e527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f915b1210048828a2fa68d1b904519, user_id=432ceb18b30f46caa8e7f9e3157814e7, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:34.037812 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698190b2-ed72-4e5a-9328-5a1d3f05e527 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:34.051447 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1429/2865] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:02:34 2022] PUT /identity/v3/projects/69f915b1210048828a2fa68d1b904519/users/432ceb18b30f46caa8e7f9e3157814e7/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:34.062545 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583cb40-2aa0-4319-be55-6f6e2eb7e4a7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:34.063110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583cb40-2aa0-4319-be55-6f6e2eb7e4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:34.063110 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583cb40-2aa0-4319-be55-6f6e2eb7e4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:34.090497 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4583cb40-2aa0-4319-be55-6f6e2eb7e4a7 None None] MFA Rules not processed for user `432ceb18b30f46caa8e7f9e3157814e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:34.092202 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4583cb40-2aa0-4319-be55-6f6e2eb7e4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:34.110411 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:34.164473 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1437/2866] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:34.176261 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698190b2-ed72-4e5a-9328-5a1d3f05e527 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:34.177971 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-698190b2-ed72-4e5a-9328-5a1d3f05e527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:34.236166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698190b2-ed72-4e5a-9328-5a1d3f05e527 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:34.239829 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a77d9f-17d8-49f3-90f5-46e332636283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:34.240445 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a77d9f-17d8-49f3-90f5-46e332636283 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:34.240720 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a77d9f-17d8-49f3-90f5-46e332636283 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:34.240988 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a77d9f-17d8-49f3-90f5-46e332636283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:34.249231 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a77d9f-17d8-49f3-90f5-46e332636283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:34.250651 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a77d9f-17d8-49f3-90f5-46e332636283 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:34.259587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1430/2867] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:34.285408 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583cb40-2aa0-4319-be55-6f6e2eb7e4a7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:34.351231 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583cb40-2aa0-4319-be55-6f6e2eb7e4a7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:34.355795 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:34.356446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:34.357325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:34.357628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] PATH_INFO: `/v3/users/432ceb18b30f46caa8e7f9e3157814e7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:34.358814 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=432ceb18b30f46caa8e7f9e3157814e7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:34.360775 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:34.406840 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432ceb18b30f46caa8e7f9e3157814e7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:34.414145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432ceb18b30f46caa8e7f9e3157814e7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:34.432125 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432ceb18b30f46caa8e7f9e3157814e7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:34.433063 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432ceb18b30f46caa8e7f9e3157814e7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:34.440750 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432ceb18b30f46caa8e7f9e3157814e7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:34.446670 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1438/2868] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:02:34 2022] DELETE /identity/v3/users/432ceb18b30f46caa8e7f9e3157814e7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:34.452038 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125197d-9628-44ae-90ae-746d78cfe329 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:34.452374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125197d-9628-44ae-90ae-746d78cfe329 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:34.452650 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125197d-9628-44ae-90ae-746d78cfe329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:34.472228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e125197d-9628-44ae-90ae-746d78cfe329 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:34.473563 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e125197d-9628-44ae-90ae-746d78cfe329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:34.534542 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1431/2869] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:34.544768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:34.546164 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:34.586278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:34.605333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bae4c-42b9-47d1-b7a2-fee6d772df7c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:34.609452 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea49d5-89d1-4807-bcec-19cb3d0bdbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:34.610076 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea49d5-89d1-4807-bcec-19cb3d0bdbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:34.610358 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea49d5-89d1-4807-bcec-19cb3d0bdbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:34.610656 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea49d5-89d1-4807-bcec-19cb3d0bdbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:34.620086 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea49d5-89d1-4807-bcec-19cb3d0bdbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:34.621543 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea49d5-89d1-4807-bcec-19cb3d0bdbc0 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:34.632004 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1439/2870] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:34.918853 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125197d-9628-44ae-90ae-746d78cfe329 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:34.921018 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e125197d-9628-44ae-90ae-746d78cfe329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:34.933655 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125197d-9628-44ae-90ae-746d78cfe329 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:34.938450 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:34.939228 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:34.939586 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:34.939930 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] PATH_INFO: `/v3/projects/69f915b1210048828a2fa68d1b904519` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:34.941250 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f915b1210048828a2fa68d1b904519)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:34.943397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:34.992673 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f915b1210048828a2fa68d1b904519', 'request_id': 'req-0b9c4a89-c355-42e2-ae34-4ff3e446858b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:35.000587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f915b1210048828a2fa68d1b904519', 'request_id': 'req-0b9c4a89-c355-42e2-ae34-4ff3e446858b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:35.006325 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f915b1210048828a2fa68d1b904519', 'request_id': 'req-0b9c4a89-c355-42e2-ae34-4ff3e446858b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:35.017202 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] The token cache is being invalidate because project 69f915b1210048828a2fa68d1b904519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:02:35.017492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:35.018128 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0b9c4a89-c355-42e2-ae34-4ff3e446858b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:35.019682 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1432/2871] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:02:34 2022] DELETE /identity/v3/projects/69f915b1210048828a2fa68d1b904519 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:35.024462 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173c447-1724-4447-8f1d-6051006de48b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.024751 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173c447-1724-4447-8f1d-6051006de48b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.025025 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173c447-1724-4447-8f1d-6051006de48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.046304 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2173c447-1724-4447-8f1d-6051006de48b None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:35.047853 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2173c447-1724-4447-8f1d-6051006de48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:35.108322 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1440/2872] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:35.117803 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141587-9101-4347-97fd-f2db97b8f88d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.118010 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141587-9101-4347-97fd-f2db97b8f88d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.118272 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141587-9101-4347-97fd-f2db97b8f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.133305 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:35.139660 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-84141587-9101-4347-97fd-f2db97b8f88d None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:35.141328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-84141587-9101-4347-97fd-f2db97b8f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:35.150397 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1433/2873] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:35.155321 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173c447-1724-4447-8f1d-6051006de48b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:35.165902 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173c447-1724-4447-8f1d-6051006de48b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:35.171769 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785256e7-58a0-4e55-925e-dcbd8739f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:35.172500 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785256e7-58a0-4e55-925e-dcbd8739f168 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.172778 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785256e7-58a0-4e55-925e-dcbd8739f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.173059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785256e7-58a0-4e55-925e-dcbd8739f168 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.173763 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785256e7-58a0-4e55-925e-dcbd8739f168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:02:35.174071 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785256e7-58a0-4e55-925e-dcbd8739f168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:35.175734 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785256e7-58a0-4e55-925e-dcbd8739f168 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:35.188174 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1441/2874] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Jul 27 08:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:02:35.192775 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141587-9101-4347-97fd-f2db97b8f88d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:35.203500 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141587-9101-4347-97fd-f2db97b8f88d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:35.208295 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e042-5198-422b-abe7-f422c5dbae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:35.208919 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e042-5198-422b-abe7-f422c5dbae52 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.209200 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e042-5198-422b-abe7-f422c5dbae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.209473 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e042-5198-422b-abe7-f422c5dbae52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.210156 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641e042-5198-422b-abe7-f422c5dbae52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:35.212126 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641e042-5198-422b-abe7-f422c5dbae52 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:35.242245 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1434/2875] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Jul 27 08:02:35 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:02:35.246340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785256e7-58a0-4e55-925e-dcbd8739f168 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:35.257049 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785256e7-58a0-4e55-925e-dcbd8739f168 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:35.314018 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9899d-ecd2-454a-a0f5-0cfa14f1d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:35.314638 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9899d-ecd2-454a-a0f5-0cfa14f1d9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.314963 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9899d-ecd2-454a-a0f5-0cfa14f1d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.315245 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9899d-ecd2-454a-a0f5-0cfa14f1d9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.315909 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9899d-ecd2-454a-a0f5-0cfa14f1d9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:35.317843 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9899d-ecd2-454a-a0f5-0cfa14f1d9b8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:35.340695 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1442/2876] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 27 08:02:35 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:02:35.345879 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e042-5198-422b-abe7-f422c5dbae52 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:35.356458 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e042-5198-422b-abe7-f422c5dbae52 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:35.361175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80f36-45e7-404f-b822-f9873f6038a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:35.361786 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80f36-45e7-404f-b822-f9873f6038a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.362065 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80f36-45e7-404f-b822-f9873f6038a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.362338 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80f36-45e7-404f-b822-f9873f6038a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.363070 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de80f36-45e7-404f-b822-f9873f6038a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:35.364688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de80f36-45e7-404f-b822-f9873f6038a3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:35.375175 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1435/2877] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:35.379224 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9899d-ecd2-454a-a0f5-0cfa14f1d9b8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:35.389768 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9899d-ecd2-454a-a0f5-0cfa14f1d9b8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:35.394494 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ded9f-1671-43a8-9d58-b3e0763b23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:35.395127 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ded9f-1671-43a8-9d58-b3e0763b23fe admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.395409 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ded9f-1671-43a8-9d58-b3e0763b23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.395684 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ded9f-1671-43a8-9d58-b3e0763b23fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.396377 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ded9f-1671-43a8-9d58-b3e0763b23fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:35.397979 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ded9f-1671-43a8-9d58-b3e0763b23fe admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:35.411266 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1443/2878] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Jul 27 08:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:02:35.415501 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80f36-45e7-404f-b822-f9873f6038a3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:35.429714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80f36-45e7-404f-b822-f9873f6038a3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:35.435467 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ac90c-f03e-440c-852c-822eeb4bea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:35.436146 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ac90c-f03e-440c-852c-822eeb4bea11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.436421 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ac90c-f03e-440c-852c-822eeb4bea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.436688 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ac90c-f03e-440c-852c-822eeb4bea11 admin admin] PATH_INFO: `/v3/projects/0eb7591a940c489c8f81bee4ccbd12d7/users/ae986e775f6c4d4c9f6daf14d683d701/roles/a53dca7201f54f8b841a25178a7e91a6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.452758 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ac90c-f03e-440c-852c-822eeb4bea11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb7591a940c489c8f81bee4ccbd12d7, user_id=ae986e775f6c4d4c9f6daf14d683d701, role_id=a53dca7201f54f8b841a25178a7e91a6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:35.456946 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ac90c-f03e-440c-852c-822eeb4bea11 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:35.470166 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1436/2879] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Jul 27 08:02:35 2022] PUT /identity/v3/projects/0eb7591a940c489c8f81bee4ccbd12d7/users/ae986e775f6c4d4c9f6daf14d683d701/roles/a53dca7201f54f8b841a25178a7e91a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:35.481745 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543369f-b30e-4647-aada-d9b5c37c7b8f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.482056 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543369f-b30e-4647-aada-d9b5c37c7b8f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.482336 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543369f-b30e-4647-aada-d9b5c37c7b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.509186 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f543369f-b30e-4647-aada-d9b5c37c7b8f None None] MFA Rules not processed for user `ae986e775f6c4d4c9f6daf14d683d701`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:35.510437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f543369f-b30e-4647-aada-d9b5c37c7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:35.548960 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:35.585515 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1444/2880] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:02:35.596519 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ac90c-f03e-440c-852c-822eeb4bea11 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:35.598332 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bb7ac90c-f03e-440c-852c-822eeb4bea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:35.655474 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ac90c-f03e-440c-852c-822eeb4bea11 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:35.659063 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce451b-a73d-46db-a116-b898a9fbcc35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1eae16b54c46e9a92f423094085b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:35.659678 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce451b-a73d-46db-a116-b898a9fbcc35 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:35.659960 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce451b-a73d-46db-a116-b898a9fbcc35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:35.660236 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce451b-a73d-46db-a116-b898a9fbcc35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:35.668704 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce451b-a73d-46db-a116-b898a9fbcc35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:35.670350 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce451b-a73d-46db-a116-b898a9fbcc35 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:35.679511 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1437/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:42.013330 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543369f-b30e-4647-aada-d9b5c37c7b8f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:42.014741 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f543369f-b30e-4647-aada-d9b5c37c7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:42.083614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543369f-b30e-4647-aada-d9b5c37c7b8f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:42.088822 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492832f-785f-4eea-9780-27636ee5b03a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:42.089443 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492832f-785f-4eea-9780-27636ee5b03a service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:42.089727 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492832f-785f-4eea-9780-27636ee5b03a service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:42.090003 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492832f-785f-4eea-9780-27636ee5b03a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:42.091798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a492832f-785f-4eea-9780-27636ee5b03a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:42.104340 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492832f-785f-4eea-9780-27636ee5b03a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:42.105930 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492832f-785f-4eea-9780-27636ee5b03a service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:42.115993 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1445/2882] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:45.675266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:51.111600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce451b-a73d-46db-a116-b898a9fbcc35 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:51.199024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce451b-a73d-46db-a116-b898a9fbcc35 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:51.208264 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:51.208939 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:51.209219 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:51.209492 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] PATH_INFO: `/v3/users/ae986e775f6c4d4c9f6daf14d683d701` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:51.210707 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae986e775f6c4d4c9f6daf14d683d701)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:51.212683 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:51.263618 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae986e775f6c4d4c9f6daf14d683d701'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.277390 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae986e775f6c4d4c9f6daf14d683d701'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.278117 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae986e775f6c4d4c9f6daf14d683d701'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.296605 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae986e775f6c4d4c9f6daf14d683d701'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.297248 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae986e775f6c4d4c9f6daf14d683d701'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.310229 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1438/2883] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:02:51 2022] DELETE /identity/v3/users/ae986e775f6c4d4c9f6daf14d683d701 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:02:51.315431 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d90814-fc68-4762-af35-e41a82be0844 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:51.315947 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d90814-fc68-4762-af35-e41a82be0844 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:51.316102 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d90814-fc68-4762-af35-e41a82be0844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:51.336134 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f0d90814-fc68-4762-af35-e41a82be0844 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:02:51.337458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f0d90814-fc68-4762-af35-e41a82be0844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:51.402043 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1446/2884] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:02:51.412059 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:51.413516 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:51.481442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8237b4-ed73-4f07-9868-1ea4c7e50928 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:51.485405 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54529-8cda-4157-ba29-b74c0c351fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:51.486042 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54529-8cda-4157-ba29-b74c0c351fed service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:51.486320 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54529-8cda-4157-ba29-b74c0c351fed service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:51.486600 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54529-8cda-4157-ba29-b74c0c351fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:51.496297 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e54529-8cda-4157-ba29-b74c0c351fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:51.497743 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e54529-8cda-4157-ba29-b74c0c351fed service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:51.508174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1439/2885] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:02:51.806706 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d90814-fc68-4762-af35-e41a82be0844 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:02:51.808253 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f0d90814-fc68-4762-af35-e41a82be0844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:02:51.824239 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d90814-fc68-4762-af35-e41a82be0844 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:02:51.840571 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:02:51.841237 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:02:51.841512 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:02:51.841784 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] PATH_INFO: `/v3/projects/0eb7591a940c489c8f81bee4ccbd12d7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:02:51.846533 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb7591a940c489c8f81bee4ccbd12d7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:02:51.848510 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:02:51.915227 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb7591a940c489c8f81bee4ccbd12d7', 'request_id': 'req-8ed89f81-ed89-427c-bdd9-b6867890e577'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.924244 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb7591a940c489c8f81bee4ccbd12d7', 'request_id': 'req-8ed89f81-ed89-427c-bdd9-b6867890e577'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.926361 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:51.930523 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb7591a940c489c8f81bee4ccbd12d7', 'request_id': 'req-8ed89f81-ed89-427c-bdd9-b6867890e577'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.946463 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] The token cache is being invalidate because project 0eb7591a940c489c8f81bee4ccbd12d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:02:51.946755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.947458 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:02:51.948975 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1447/2886] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:02:51 2022] DELETE /identity/v3/projects/0eb7591a940c489c8f81bee4ccbd12d7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:03:01.503933 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:01.943168 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=5,keystone:DELETE=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:12.867580 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b268d6-371c-4992-9645-b2d799e4d1b2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:12.868130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b268d6-371c-4992-9645-b2d799e4d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:12.868130 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b268d6-371c-4992-9645-b2d799e4d1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:12.888125 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-81b268d6-371c-4992-9645-b2d799e4d1b2 None None] MFA Rules not processed for user `8cf53cae7423436db120a4a0d97affae`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:03:12.889365 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-81b268d6-371c-4992-9645-b2d799e4d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:12.946552 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1440/2887] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:03:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:03:13.199272 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:03:13.200895 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:13.267527 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed89f81-ed89-427c-bdd9-b6867890e577 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:03:13.273317 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:03:13.274060 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:13.274387 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:13.274668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:13.276791 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:13.288199 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:03:13.289668 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:03:13.298589 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1448/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:03:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:03:17.003694 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b268d6-371c-4992-9645-b2d799e4d1b2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:03:17.005227 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-81b268d6-371c-4992-9645-b2d799e4d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:17.017558 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b268d6-371c-4992-9645-b2d799e4d1b2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:03:17.022091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a772-439a-4acb-80c6-e983f81e8f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:03:17.022714 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a772-439a-4acb-80c6-e983f81e8f74 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:17.023103 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a772-439a-4acb-80c6-e983f81e8f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:17.023379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a772-439a-4acb-80c6-e983f81e8f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:17.025163 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4d18a772-439a-4acb-80c6-e983f81e8f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:17.093118 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a772-439a-4acb-80c6-e983f81e8f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:03:17.094562 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a772-439a-4acb-80c6-e983f81e8f74 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:03:17.106004 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1441/2889] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:03:23.294563 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=26 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:23.453351 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:03:23.454954 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:23.469446 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd665e33-947d-4038-a5b2-9fa921e9c0fe service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:03:23.475383 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:03:23.476503 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:23.476779 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:23.477208 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] PATH_INFO: `/v3/users/bf5c7fa61d5c4e88a0897cc5007cad93` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:23.478610 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5c7fa61d5c4e88a0897cc5007cad93)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:03:23.480812 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:03:23.546560 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5c7fa61d5c4e88a0897cc5007cad93'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:23.558366 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5c7fa61d5c4e88a0897cc5007cad93'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:23.576716 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5c7fa61d5c4e88a0897cc5007cad93'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:23.577886 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5c7fa61d5c4e88a0897cc5007cad93'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:23.587329 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5c7fa61d5c4e88a0897cc5007cad93'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:23.596798 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1449/2890] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:03:23 2022] DELETE /identity/v3/users/bf5c7fa61d5c4e88a0897cc5007cad93 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:03:23.602024 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd7028-c047-4f45-b6e1-45c531c434c9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:23.603251 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd7028-c047-4f45-b6e1-45c531c434c9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:23.603852 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd7028-c047-4f45-b6e1-45c531c434c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:23.633452 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e1bd7028-c047-4f45-b6e1-45c531c434c9 None None] MFA Rules not processed for user `0d288edc5a024ebe8b9e0a02e9598b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:03:23.634698 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e1bd7028-c047-4f45-b6e1-45c531c434c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:23.720723 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1442/2891] 10.222.0.18 () {58 vars in 958 bytes} [Wed Jul 27 08:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:03:23.732435 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:03:23.733984 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:23.812834 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03b41d-4f12-4e76-8c05-06be69cf319c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:03:23.817030 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342944bb-7873-4b31-a96b-f7065711bb41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c65277d89a24081a47a7f928f6c6d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:03:23.818181 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342944bb-7873-4b31-a96b-f7065711bb41 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:23.818800 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342944bb-7873-4b31-a96b-f7065711bb41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:23.819352 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342944bb-7873-4b31-a96b-f7065711bb41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:23.832877 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342944bb-7873-4b31-a96b-f7065711bb41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:03:23.835167 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342944bb-7873-4b31-a96b-f7065711bb41 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:03:23.846872 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1450/2892] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:03:24.057588 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd7028-c047-4f45-b6e1-45c531c434c9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:03:24.059374 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e1bd7028-c047-4f45-b6e1-45c531c434c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:24.074484 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd7028-c047-4f45-b6e1-45c531c434c9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:03:24.084328 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:03:24.085011 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:24.085291 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:24.085564 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] PATH_INFO: `/v3/users/5efb3ea424f8450c883d4757545af18d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:24.111684 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5efb3ea424f8450c883d4757545af18d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:03:24.113820 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:03:24.140327 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:24.175385 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5efb3ea424f8450c883d4757545af18d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.192127 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5efb3ea424f8450c883d4757545af18d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.195312 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5efb3ea424f8450c883d4757545af18d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.201316 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342944bb-7873-4b31-a96b-f7065711bb41 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:03:24.203059 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-342944bb-7873-4b31-a96b-f7065711bb41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:24.219354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342944bb-7873-4b31-a96b-f7065711bb41 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:03:24.224147 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5efb3ea424f8450c883d4757545af18d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.224881 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5efb3ea424f8450c883d4757545af18d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.227874 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:03:24.228748 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:24.229206 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:24.230561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] PATH_INFO: `/v3/projects/057a054324cc4307b9bd69fddb928dab` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:24.232341 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=057a054324cc4307b9bd69fddb928dab)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:03:24.234308 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:03:24.243843 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1443/2893] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:03:24 2022] DELETE /identity/v3/users/5efb3ea424f8450c883d4757545af18d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:03:24.300326 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057a054324cc4307b9bd69fddb928dab', 'request_id': 'req-c35aa590-f616-4697-979a-c78891a4fee9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.311022 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057a054324cc4307b9bd69fddb928dab', 'request_id': 'req-c35aa590-f616-4697-979a-c78891a4fee9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.318439 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057a054324cc4307b9bd69fddb928dab', 'request_id': 'req-c35aa590-f616-4697-979a-c78891a4fee9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.326331 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:24.332755 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] The token cache is being invalidate because project 057a054324cc4307b9bd69fddb928dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:03:24.333419 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.334832 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.337106 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1451/2894] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:03:24 2022] DELETE /identity/v3/projects/057a054324cc4307b9bd69fddb928dab => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:03:24.463773 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:03:24.465413 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:24.555941 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a21b0f-1d62-4800-9567-ea04a5af8efc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:03:24.634284 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:03:24.634963 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:24.635158 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:24.635434 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] PATH_INFO: `/v3/projects/479f452a345b4c219d32d2ad78183af6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:24.646503 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=479f452a345b4c219d32d2ad78183af6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:03:24.648406 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:03:24.695418 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:24.702367 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479f452a345b4c219d32d2ad78183af6', 'request_id': 'req-5cf17545-1188-4d09-a952-5af7361057ab'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.709689 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479f452a345b4c219d32d2ad78183af6', 'request_id': 'req-5cf17545-1188-4d09-a952-5af7361057ab'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.715442 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479f452a345b4c219d32d2ad78183af6', 'request_id': 'req-5cf17545-1188-4d09-a952-5af7361057ab'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.727180 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] The token cache is being invalidate because project 479f452a345b4c219d32d2ad78183af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:03:24.727472 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.728120 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.729647 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1444/2895] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:03:24 2022] DELETE /identity/v3/projects/479f452a345b4c219d32d2ad78183af6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:03:24.733851 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:03:24.735437 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:24.749109 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa590-f616-4697-979a-c78891a4fee9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:03:24.805687 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:03:24.806325 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:24.806608 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:24.806910 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] PATH_INFO: `/v3/users/91de80583d3446799cd6256e3115fa16` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:24.821091 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91de80583d3446799cd6256e3115fa16)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:03:24.822956 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:03:24.870774 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91de80583d3446799cd6256e3115fa16'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.882187 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91de80583d3446799cd6256e3115fa16'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.899278 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91de80583d3446799cd6256e3115fa16'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.900047 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91de80583d3446799cd6256e3115fa16'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.911263 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91de80583d3446799cd6256e3115fa16'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:24.920455 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1452/2896] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:03:24 2022] DELETE /identity/v3/users/91de80583d3446799cd6256e3115fa16 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:03:25.095782 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:03:25.097830 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:03:25.113079 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf17545-1188-4d09-a952-5af7361057ab admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:03:25.169243 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:03:25.169809 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:03:25.170091 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:03:25.170366 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] PATH_INFO: `/v3/projects/bc325b50f2a84949b5d97a80215eae8e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:03:25.181851 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc325b50f2a84949b5d97a80215eae8e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:03:25.183874 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:03:25.230965 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc325b50f2a84949b5d97a80215eae8e', 'request_id': 'req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:25.239008 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc325b50f2a84949b5d97a80215eae8e', 'request_id': 'req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:25.244691 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc325b50f2a84949b5d97a80215eae8e', 'request_id': 'req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:25.256174 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] The token cache is being invalidate because project bc325b50f2a84949b5d97a80215eae8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:03:25.256463 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:25.257105 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:03:25.258627 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1445/2897] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:03:25 2022] DELETE /identity/v3/projects/bc325b50f2a84949b5d97a80215eae8e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:03:34.916388 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:35.253172 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=64,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:04:17.284664 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:04:17.286123 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:04:17.300108 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ff95b-580d-4eb5-873e-88fb340b6074 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:04:17.358374 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:04:17.359137 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:04:17.359354 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:04:17.359629 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] PATH_INFO: `/v3/users/8cf53cae7423436db120a4a0d97affae` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:04:17.360790 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf53cae7423436db120a4a0d97affae)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:04:17.362736 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:04:17.409156 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf53cae7423436db120a4a0d97affae'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.416255 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf53cae7423436db120a4a0d97affae'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.428730 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf53cae7423436db120a4a0d97affae'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.429426 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf53cae7423436db120a4a0d97affae'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.436584 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf53cae7423436db120a4a0d97affae'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.442628 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1453/2898] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Jul 27 08:04:17 2022] DELETE /identity/v3/users/8cf53cae7423436db120a4a0d97affae => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:04:17.623111 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:04:17.624623 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:04:17.638379 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f68615-4da0-4a65-bfd1-2a4cdb5a0972 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:04:17.696403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d288edc5a024ebe8b9e0a02e9598b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b01056c5a4f74067a3bc2250b32736cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:04:17.697041 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:04:17.697318 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:04:17.697587 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] PATH_INFO: `/v3/projects/ab5d3df5b9a5418e95246ec89a22c7df` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:04:17.698732 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5d3df5b9a5418e95246ec89a22c7df)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:04:17.701268 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:04:17.748266 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5d3df5b9a5418e95246ec89a22c7df', 'request_id': 'req-891b1865-8710-476e-a57c-4d3989b6bffe'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.755770 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5d3df5b9a5418e95246ec89a22c7df', 'request_id': 'req-891b1865-8710-476e-a57c-4d3989b6bffe'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.761571 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5d3df5b9a5418e95246ec89a22c7df', 'request_id': 'req-891b1865-8710-476e-a57c-4d3989b6bffe'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.772953 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] The token cache is being invalidate because project ab5d3df5b9a5418e95246ec89a22c7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:04:17.773234 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.773856 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-891b1865-8710-476e-a57c-4d3989b6bffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:04:17.775403 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1446/2899] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Jul 27 08:04:17 2022] DELETE /identity/v3/projects/ab5d3df5b9a5418e95246ec89a22c7df => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:04:27.439145 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:04:27.770000 dv-cinder-825492-32-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:07:44.292614 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:07:44.294033 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:07:44.437073 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d251148-6146-438d-84b5-c77816cca043 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:07:44.497156 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862c2fd-e2b5-4d56-912e-74358f2cb143 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beaec3b392e3468981992629101cf883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd9a3718f41969b6d191475d1174e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:07:44.497787 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c2fd-e2b5-4d56-912e-74358f2cb143 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:07:44.498062 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c2fd-e2b5-4d56-912e-74358f2cb143 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:07:44.498333 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c2fd-e2b5-4d56-912e-74358f2cb143 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:07:44.500238 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4862c2fd-e2b5-4d56-912e-74358f2cb143 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:07:44.511561 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862c2fd-e2b5-4d56-912e-74358f2cb143 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:07:44.513128 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862c2fd-e2b5-4d56-912e-74358f2cb143 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:07:44.523207 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1454/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 27 08:07:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:07:54.518735 dv-cinder-825492-32-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}